microsoft / microsoft/OmniParser

Strange behavior / security errors

Open
#168 1 comment 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Jupyter Notebook
Stars
25.4k
Forks
2.2k
PR merge metrics
No merged PRs in 30d

Description

Hello,

Running the gradio example results in a virus-like (at least per my antivirus) file to be required.

Several others are reporting the issue as well.

Steps to reproduce:

  1. Clone this Omniparser repo
  2. Clone the Omniparser-V2 repo from HuggingFace
  3. Move the HuggingFace files into the Omniparser repo into a weights directory
  4. pip install -r requirements.txt
  5. python gradio

Results:

(.venv) PS C:\Users\me\Documents\projects\omniparser> python .\gradio_demo.py
[2025-02-18 15:17:30,134] [ WARNING] easyocr.py:80 - Neither CUDA nor MPS are available - defaulting to CPU. Note: This module is much faster with a GPU.
configuration_florence2.py: 100%|█| 15.1k/15.1k [00:00<00:00, 1
A new version of the following files was downloaded from https://huggingface.co/microsoft/Florence-2-base-ft:
- configuration_florence2.py
. Make sure to double-check they do not contain any added malicious code. To avoid downloading new versions of the code file, you can pin a revision.
modeling_florence2.py: 100%|█| 127k/127k [00:00<00:00, 1.31MB/s
A new version of the following files was downloaded from https://huggingface.co/microsoft/Florence-2-base-ft:
- modeling_florence2.py
. Make sure to double-check they do not contain any added malicious code. To avoid downloading new versions of the code file, you can pin a revision.
Florence2LanguageForConditionalGeneration has generative capabilities, as `prepare_inputs_for_generation` is explicitly overwritten. However, it doesn't directly inherit from `GenerationMixin`. From 👉v4.50👈 onwards, `PreTrainedModel` will NOT inherit from `GenerationMixin`, and this model will lose the ability to call `generate` and other related functions.
  - If you're using `trust_remote_code=True`, you can get rid of this warning by loading the model with an auto class. See https://huggingface.co/docs/transformers/en/model_doc/auto#auto-classes
  - If you are the owner of the model architecture code, please modify your model class such that it inherits from `GenerationMixin` (after `PreTrainedModel`, otherwise you'll get an exception).
  - If you are not the owner of the model architecture class, please contact the model code owner to update it.
* Running on local URL:  http://0.0.0.0:7861

Could not create share link. Missing file: C:\Users\me\Documents\projects\omniparser\.venv\Lib\site-packages\gradio\frpc_windows_amd64_v0.3.

Please check your internet connection. This can happen if your antivirus software blocks the download of this file. You can install manually by following these steps:

1. Download this file: https://cdn-media.huggingface.co/frpc-gradio-0.3/frpc_windows_amd64.exe
2. Rename the downloaded file to: frpc_windows_amd64_v0.3       
3. Move the file to this location: C:\Users\me\Documents\projects\omniparser\.venv\Lib\site-packages\gradio

Attempting to follow the instructions in the terminal output (by downloading the frpc_windows_amd64.exe file from huggingface) immediately triggered my antivirus.

I will not be running this Omniparser demo until this is rectified by Microsoft.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with gradio_demo.py and requirements.txt, then trace the gradio frpc_windows_amd64_v0.3 download reported in the terminal output on Windows. Check whether the behavior is in OmniParser or the Gradio dependency, and document a safe, reproducible resolution when the antivirus blocks the file.

Written by the indexing model from the issue text.

Assessment

Tech stack
jupyter-notebook, python
Domain
security
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.