open-compass / open-compass/VLMEvalKit

Update evaluation records of InternVL3

Open
#1,372 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
4.4k
Forks
768
Avg merge
1d 10h
Merged PRs (30d)
17

Description

Hi,

Thank you for sharing the evaluation kit and the records. Would it be possible to update the records in VLMEval/OpenVLMRecords to include the InternVL3 series?

That would be really helpful!

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reading the existing records in VLMEval/OpenVLMRecords and compare how other model series are represented. Identify the fields and entries needed for the InternVL3 series, then verify that the updated records are recognized by the repository’s existing evaluation setup. Done means the InternVL3 series is represented in that records location.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.