open-compass/opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

Stars: 7.5k
Forks: 869
Open beginner issues: 2
Indexed issues: 290
Avg merge: 17h 52m
Merged PRs (30d): 13

Dominant language: Python
License: Apache-2.0
Last GitHub push: Sep 16, 2026
Latest indexed: Sep 19, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: good first issue

Beginner friendly Everything

Open All

2 beginner-friendly issues open

`gsm8k_postprocess` breaks numeric answers at thousands separators (`\boxed{$9{,}500}` → `500`, `\boxed{8,000}` → `000`) Open

Difficulty 2/5 1-3 hours Newbie friendliness 84/100

open-compass/opencompass#2647 · 2 comments · Opened Sep 18, 2026
TopkRetriever crashes on transformers 5.x: tokenizer.encode_plus was removed Open

Difficulty 2/5 1-3 hours Newbie friendliness 75/100

open-compass/opencompass#2635 · Opened Sep 8, 2026

A short digest of beginner-friendly GitHub issues.