open-compass / open-compass/VLMEvalKit
azure or vertex
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 4.4k
- Forks
- 768
- Avg merge
- 1d 10h
- Merged PRs (30d)
- 17
Description
如果我使用azure的gpt4o api，或者vertex的gemini 2.5 pro
我应该在.env文件里怎么写
If I use Azure's GPT - 4O API or Vertex's Gemini 2.5 Pro, what should I write in the .env file?
我这样写但是报错了
my .env文件
OPENAI_API_KEY="my key"
OPENAI_API_BASE="my link"
got error
/mnt/largeml-train-gui-agent/hankaiyang/packages/VLMEvalKit/vlmeval/dataset/image_mcq.py:254: UserWarning: OPENAI_API_KEY is not set properly, will use exact matching for evaluation
warnings.warn('OPENAI_API_KEY is not set properly, will use exact matching for evaluation')
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading the warning around vlmeval/dataset/image_mcq.py:254 and search the repository for OPENAI_API_KEY and OPENAI_API_BASE usage. Check how Azure GPT-4o and Vertex Gemini 2.5 Pro are selected and configured; done means the documented environment variables are accepted without the warning and the intended API path is used.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- azure, google-cloud, python
- Domain
- api, cloud
- Issue type
- Bug
- Difficulty
- 2/5
- Estimated time
- 1-3 hours
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 30/100