open-compass / open-compass/VLMEvalKit

Dependency conflicts with NumPy, OpenCV, and Numba prevent installation

Open
#1,252 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
4.4k
Forks
768
Avg merge
1d 10h
Merged PRs (30d)
17

Description

Attempting to install VLMEvalKit on Python 3.10 with the recommended instructions leads to dependency conflicts. Certain required packages cannot coexist due to NumPy version requirements:

**numba 0.57.1+1.g5fba9aa8f requires numpy>=1.21, <1.25

opencv-python 4.12.0.88 requires numpy>=2, <2.3**

Installing any single version of NumPy either breaks Numba or OpenCV. This leads to runtime errors.

steps to reproduce

  1. Start a fresh container or Python 3.10.12 environment
  2. Follow the quickstart instructions: pip install -e .
  3. Attempt to check a model: vlmutil check Qwen2-VL-7B-Instruct

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Reproduce the conflict in a fresh Python 3.10.12 environment by following the quickstart instructions and running pip install -e ., then try vlmutil check Qwen2-VL-7B-Instruct. Review the dependency requirements involved in the installation and confirm the fix when installation succeeds without incompatible NumPy constraints and the check command runs.

Written by the indexing model from the issue text.

Assessment

Tech stack
numpy, opencv, python
Domain
build-system, computer-vision, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.