open-compass / open-compass/VLMEvalKit
有些基准没有放数据url
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 4.4k
- Forks
- 768
- Avg merge
- 1d 10h
- Merged PRs (30d)
- 17
Description
有些基准没有放数据url，比如mmhelix.py，omnimat似乎没有公开的数据下载地址，scidocbench的链接是空的（https://opencompass.openxlab.space/utils/VLMEvalKit/SciDocBench.tsv），MATBench的链接没法下载。
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the benchmark definitions for mmhelix.py, Omnimat, SciDocBench, and MATBench, then inspect how their data URLs are configured. Verify each referenced address, including the SciDocBench URL in the issue, and check the project’s existing benchmark-data conventions. Done means the listed benchmarks have usable, accurate download URLs or a clearly recorded explanation where data is not publicly available.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data, testing-qa
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 48/100