microsoft / microsoft/OmniParser
Strange behavior / security errors
Nobody has claimed this yet.
- Dominant language
- Jupyter Notebook
- Stars
- 25.4k
- Forks
- 2.2k
- PR merge metrics
- No merged PRs in 30d
Description
Hello,
Running the gradio example results in a virus-like (at least per my antivirus) file to be required.
Several others are reporting the issue as well.
Steps to reproduce:
- Clone this Omniparser repo
- Clone the Omniparser-V2 repo from HuggingFace
- Move the HuggingFace files into the Omniparser repo into a
weightsdirectory pip install -r requirements.txtpython gradio
Results:
(.venv) PS C:\Users\me\Documents\projects\omniparser> python .\gradio_demo.py
[2025-02-18 15:17:30,134] [ WARNING] easyocr.py:80 - Neither CUDA nor MPS are available - defaulting to CPU. Note: This module is much faster with a GPU.
configuration_florence2.py: 100%|█| 15.1k/15.1k [00:00<00:00, 1
A new version of the following files was downloaded from https://huggingface.co/microsoft/Florence-2-base-ft:
- configuration_florence2.py
. Make sure to double-check they do not contain any added malicious code. To avoid downloading new versions of the code file, you can pin a revision.
modeling_florence2.py: 100%|█| 127k/127k [00:00<00:00, 1.31MB/s
A new version of the following files was downloaded from https://huggingface.co/microsoft/Florence-2-base-ft:
- modeling_florence2.py
. Make sure to double-check they do not contain any added malicious code. To avoid downloading new versions of the code file, you can pin a revision.
Florence2LanguageForConditionalGeneration has generative capabilities, as `prepare_inputs_for_generation` is explicitly overwritten. However, it doesn't directly inherit from `GenerationMixin`. From 👉v4.50👈 onwards, `PreTrainedModel` will NOT inherit from `GenerationMixin`, and this model will lose the ability to call `generate` and other related functions.
- If you're using `trust_remote_code=True`, you can get rid of this warning by loading the model with an auto class. See https://huggingface.co/docs/transformers/en/model_doc/auto#auto-classes
- If you are the owner of the model architecture code, please modify your model class such that it inherits from `GenerationMixin` (after `PreTrainedModel`, otherwise you'll get an exception).
- If you are not the owner of the model architecture class, please contact the model code owner to update it.
* Running on local URL: http://0.0.0.0:7861
Could not create share link. Missing file: C:\Users\me\Documents\projects\omniparser\.venv\Lib\site-packages\gradio\frpc_windows_amd64_v0.3.
Please check your internet connection. This can happen if your antivirus software blocks the download of this file. You can install manually by following these steps:
1. Download this file: https://cdn-media.huggingface.co/frpc-gradio-0.3/frpc_windows_amd64.exe
2. Rename the downloaded file to: frpc_windows_amd64_v0.3
3. Move the file to this location: C:\Users\me\Documents\projects\omniparser\.venv\Lib\site-packages\gradio
Attempting to follow the instructions in the terminal output (by downloading the frpc_windows_amd64.exe file from huggingface) immediately triggered my antivirus.
I will not be running this Omniparser demo until this is rectified by Microsoft.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with gradio_demo.py and requirements.txt, then trace the gradio frpc_windows_amd64_v0.3 download reported in the terminal output on Windows. Check whether the behavior is in OmniParser or the Gradio dependency, and document a safe, reproducible resolution when the antivirus blocks the file.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- jupyter-notebook, python
- Domain
- security
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100