ByteDance-Seed / ByteDance-Seed/m3-agent

Could you please double check the Video-MME-Long score for MA-LMM in your main result table?

Open
#6 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.4k
Forks
117
PR merge metrics
No merged PRs in 30d

Description

The score for MA-LMM for Video-MME-Long is 7.2, which seems a big discrepancy compared to its other score in your main result table.

I believe MA-LMM paper does not present the benchmark on Video-MME-Long, therefore, there might be some mistakes in your evaluation pipeline, which makes your result table not as valid as it should.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.