open-compass / open-compass/VLMEvalKit
通过LMDeployAPI方式部署Qwen2-VL-7B-Instruct，测精度
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 4.4k
- Forks
- 768
- Avg merge
- 1d 10h
- Merged PRs (30d)
- 17
Description
- 当前Qwen2VLChat方式只支持本地加载方式
- LMDeployAPI方式不支持Qwen2-VL-7B-Instruct
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading the Qwen2VLChat and LMDeployAPI integration paths to understand how local loading is handled and where model support is selected. Confirm the expected LMDeploy API interface for Qwen2-VL-7B-Instruct, then run the relevant evaluation flow and compare its accuracy with the existing Qwen2VLChat path.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100