Owner
open-compass
3 indexed repositories · View on GitHub
-
opencompass
OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, ...
Python · 7455 stars
-
VLMEvalKit
Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
Python · 4400 stars
-
AgentCompass
[EMNLP 2026] AgentCompass is an extensible open-source evaluation infrastructure for systematically assessing LLM/VLM agent capabilities.
Python · 135 stars
-
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
open-compass/opencompass#2647 · 2 comments ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
open-compass/VLMEvalKit#1690 · 3 comments ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
open-compass/VLMEvalKit#1689 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 85/100
open-compass/VLMEvalKit#1675 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 75/100
open-compass/opencompass#2635 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
open-compass/AgentCompass#276 ·
-
Difficulty 1/5 Under an hour Newbie friendliness 78/100
open-compass/VLMEvalKit#1589 · 1 comment ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 78/100
open-compass/VLMEvalKit#1580 ·
-
Difficulty 2/5 1-3 hours Newbie friendliness 68/100
open-compass/VLMEvalKit#1528 ·