allenai / allenai/SAGE

Verify evals on Papers with Code

未关闭
#7 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
主要语言
Python
星标
70
派生
4
PR 合并指标
30 天内没有已合并 PR

描述

Hi,

Niels here from the open-source team at Hugging Face. Congratulations on your work!

I've made the [paper](https://paperswithcode.co/paper/2512.13874) and [2 verified paper-native evaluations](https://paperswithcode.co/paper/2512.13874#results) available on Papers with Code.

The paper is part of the [Video Understanding](https://paperswithcode.co/tasks/video-understanding) task page.

The SAGE-Flash (SAGE-MM: Qwen3-VL-8B-Instruct [+SFT] [+RL]) result currently ranks third on [VideoMMMU](https://paperswithcode.co/benchmark/videommmu?task=video-understanding&eval=24516).

Would it be possible to verify these results and let me know if any score, model name, benchmark protocol, or openness metadata should be corrected? The imported rows are tied to the paper or its official release artifacts; comparison-table baselines were not added.

You can also edit the task, methods, project page, and GitHub URL directly from the paper page using your Hugging Face account.

If you'd like to showcase the results in your repository README, you can copy these live leaderboard badges (or use the “Copy PwC badge” button in the Results section):

[![Papers with Code: #3 on VideoMMMU](https://paperswithcode.co/api/v1/papers/2512.13874/leaderboard-badge.svg?eval=24516&live=1)](https://paperswithcode.co/api/v1/papers/2512.13874/leaderboard-badge-link?eval=24516)

Kind regards,

Niels

贡献指南

这个仓库没有索引到贡献指南

调研方向

Start with the linked Papers with Code paper's Results section and the VideoMMMU leaderboard entry. Verify the two paper-native rows—score, model name, benchmark protocol, and openness metadata—against the paper or official release artifacts, then report or correct any discrepancies.

由索引模型根据 Issue 内容生成。

评估

领域
documentation
Issue 类型
文档
难度
2/5
预计耗时
1-3 小时
活跃度
活跃
描述清晰度
基本清楚
新手友好度
55/100

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。