modelscope/evalscope
View on GitHubA streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
- Stars
- 3.4k
- Forks
- 489
- Open beginner issues
- 0
- Indexed issues
- 28
- Avg merge
- 1d 7h
- Merged PRs (30d)
- 87
- Dominant language
- Python
- License
- Apache-2.0
- Last GitHub push
- Sep 18, 2026
- Latest indexed
- Sep 20, 2026
- Contributing guide
- Contributing guide
- Code of conduct
- No code of conduct
- Beginner labels
- No beginner labels indexed
-
Difficulty 3/5 1-2 days Newbie friendliness 45/100
modelscope/evalscope#1708 · 1 comment ·
-
Difficulty 4/5 3-5 days Newbie friendliness 52/100
modelscope/evalscope#1682 · 1 comment ·
-
Difficulty 4/5 3-5 days Newbie friendliness 52/100
modelscope/evalscope#1648 · 1 comment ·
-
Difficulty 4/5 3-5 days Newbie friendliness 30/100
modelscope/evalscope#1631 · 1 comment ·
-
ifbench评测集指标问题 Open
Difficulty 3/5 1-2 days Newbie friendliness 38/100
modelscope/evalscope#1606 · 7 comments ·
-
Difficulty 5/5 Over a week Newbie friendliness 20/100
modelscope/evalscope#1582 · 1 comment ·
-
[Feature] Framing-robustness benchmark: does a judge's moral verdict survive the act being reworded? Open
Difficulty 5/5 Over a week Newbie friendliness 35/100
modelscope/evalscope#1540 · 2 comments ·
-
Difficulty 4/5 3-5 days Newbie friendliness 52/100
modelscope/evalscope#1493 · 2 comments ·
-
enhancement
Difficulty 4/5 3-5 days Newbie friendliness 45/100
modelscope/evalscope#1452 · 1 comment ·
-
enhancement
Difficulty 5/5 Over a week Newbie friendliness 25/100
modelscope/evalscope#1393 ·
-
enhancement
Difficulty 5/5 Over a week Newbie friendliness 35/100
modelscope/evalscope#1360 · 1 comment ·
-
Difficulty 5/5 Over a week Newbie friendliness 42/100
modelscope/evalscope#1358 ·
-
enhancement
Difficulty 5/5 Over a week Newbie friendliness 42/100
modelscope/evalscope#1278 · 2 comments ·
-
enhancement
Difficulty 4/5 3-5 days Newbie friendliness 30/100
modelscope/evalscope#1151 ·
-
Audio ASR benchmarks (LibriSpeech / TORGO) fail with 400 Bad Request when using sglang server mode Open
Difficulty 4/5 3-5 days Newbie friendliness 35/100
modelscope/evalscope#1108 · 1 comment ·
-
BFCL-v4评测复现失败 Open
Difficulty 4/5 3-5 days Newbie friendliness 25/100
modelscope/evalscope#1100 · 6 comments ·
-
文生图模型无法调用本地部署的服务 Openenhancement
Difficulty 4/5 3-5 days Newbie friendliness 30/100
modelscope/evalscope#1040 · 1 comment ·
-
enhancement
Difficulty 2/5 1-3 hours Newbie friendliness 45/100
modelscope/evalscope#980 ·
-
增加对qwen-image模型的性能测试 Open
Difficulty 4/5 3-5 days Newbie friendliness 35/100
modelscope/evalscope#979 ·
-
enhancement
Difficulty 5/5 Over a week Newbie friendliness 30/100
modelscope/evalscope#974 ·
-
Difficulty 5/5 Over a week Newbie friendliness 25/100
modelscope/evalscope#951 · 3 comments · 2 reactions ·
-
enhancement
Difficulty 4/5 3-5 days Newbie friendliness 35/100
modelscope/evalscope#930 · 5 comments ·
-
enhancement
Difficulty 5/5 Over a week Newbie friendliness 25/100
modelscope/evalscope#842 · 1 comment ·
-
enhancement
Difficulty 5/5 Over a week Newbie friendliness 25/100
modelscope/evalscope#742 ·
-
Difficulty 3/5 1-2 days Newbie friendliness 48/100
modelscope/evalscope#651 · 3 comments ·
-
FewCLUE/cluewsc数据集支持 Openenhancement
Difficulty 3/5 1-2 days Newbie friendliness 35/100
modelscope/evalscope#618 · 1 comment ·
-
enhancement native
modelscope/evalscope#527 · 2 comments · 1 assignee ·
-
enhancement native
modelscope/evalscope#393 · 3 comments · 1 assignee ·