OpenGVLab / OpenGVLab/InternVideo
Question regarding InternVideo2+VideoChat2 results on MVBench
Open
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 2.4k
- Forks
- 160
- PR merge metrics
- No merged PRs in 30d
Description
Hello authors,
Table 16 in the InternVideo2 paper reports a score of 60.9 on MVBench, with VideoChat2 + InternVideo2s3-1B + Mistral-7B.
However, the highest score on MVBench leaderboard is 60.4 (VideoChat2_mistral) as of today.
I am just curious -
- Why is the 60.9 result not reported to the MVBench leaderboard yet?
- Are these two results referring to the same combination of models? If not, what's the difference?
Thanks!
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No source file, test, or entry point is identified in the issue. Start by comparing the Table 16 configuration with the MVBench leaderboard entry for VideoChat2_mistral, then document whether the results use the same model combination and explain or correct the reported discrepancy.
Written by the indexing model from the issue text.
Assessment
- Domain
- machine-learning
- Issue type
- Documentation
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100