open-compass / open-compass/VLMEvalKit

关于使用 --config 的问题

Open
#811 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
4.4k
Forks
768
Avg merge
2d 27m
Merged PRs (30d)
18

Description

run.py中有一句:

When launching with --config, args for API VLMs, such as --retry, --verbose, will be ignored.

请问,为什么在使用 --config 配置时,不能使用 api-nproc这些参数呢?基于什么样的考虑呢?

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start in run.py by tracing how --config is parsed and how API VLM arguments such as --retry, --verbose, and api-nproc are handled. Done means documenting the design rationale and clearly stating which API arguments are supported or ignored when --config is used.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
cli, developer-experience
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.