microsoft / microsoft/OmniParser

How to install and run OmniParser on Mac OS?

Open
#302 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Jupyter Notebook
Stars
25.4k
Forks
2.2k
PR merge metrics
No merged PRs in 30d

Description

I am trying to install the OmniParser and its dependencies and models on my Mac pro m3, but apparently it needs CUDA.

after downloading the models and weights and the dependencies when I run the gradio_demo.py file it needs flash_attn, and when I want to install it I encounter the following error regarding CUDA stuff . . .

pip install flash_attn

Collecting flash_attn
  Using cached flash_attn-2.7.4.post1.tar.gz (6.0 MB)
  Preparing metadata (setup.py) ... error
  error: subprocess-exited-with-error
  
  × python setup.py egg_info did not run successfully.
  │ exit code: 1
  ╰─> [21 lines of output]
      /private/var/folders/r_/l3xmnrpn5pz4519lf_td6dvc0000gn/T/pip-install-thtgcy5f/flash-attn_9b9e00f919a84f8ab7a2fd3df9ee69dc/setup.py:106: UserWarning: flash_attn was requested, but nvcc was not found.  Are you sure your environment has nvcc available?  If you're installing within a container from https://hub.docker.com/r/pytorch/pytorch, only images whose names contain 'devel' will provide nvcc.
        warnings.warn(
      Traceback (most recent call last):
        File "<string>", line 2, in <module>
        File "<pip-setuptools-caller>", line 34, in <module>
        File "/private/var/folders/r_/l3xmnrpn5pz4519lf_td6dvc0000gn/T/pip-install-thtgcy5f/flash-attn_9b9e00f919a84f8ab7a2fd3df9ee69dc/setup.py", line 198, in <module>
          CUDAExtension(
        File "/Users/benyamin/homebrew/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 1279, in CUDAExtension
          library_dirs += library_paths(device_type="cuda")
                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
        File "/Users/benyamin/homebrew/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 1490, in library_paths
          if (not os.path.exists(_join_cuda_home(lib_dir)) and
                                 ^^^^^^^^^^^^^^^^^^^^^^^^
        File "/Users/benyamin/homebrew/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 2889, in _join_cuda_home
          raise OSError('CUDA_HOME environment variable is not set. '
      OSError: CUDA_HOME environment variable is not set. Please set it to your CUDA install root.
      
      
      torch.__version__  = 2.7.0
      
      
      [end of output]
  
  note: This error originates from a subprocess, and is likely not a problem with pip.

[notice] A new release of pip is available: 25.0.1 -> 25.1.1
[notice] To update, run: python3.11 -m pip install --upgrade pip
error: metadata-generation-failed

× Encountered error while generating package metadata.
╰─> See above for output.

note: This is an issue with the package mentioned above, not pip.
hint: See above for details.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with gradio_demo.py and the installation steps described in the issue, then trace where flash_attn is required. Determine whether the documented dependencies support Mac M3, and verify any supported setup by running the demo with the required models. Done means the Mac installation path is documented or the platform limitation is clearly stated.

Written by the indexing model from the issue text.

Assessment

Tech stack
macos, python, pytorch
Domain
machine-learning, operating-systems
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.