NVIDIA-NeMo/Evaluator
View on GitHubOpen-source library for scalable, reproducible evaluation of AI models and benchmarks.
- Stars
- 341
- Forks
- 80
- Open beginner issues
- 0
- Indexed issues
- 9
- Avg merge
- 1d 5h
- Merged PRs (30d)
- 7
- Dominant language
- Python
- License
- Apache-2.0
- Last GitHub push
- Sep 8, 2026
- Latest indexed
- Sep 19, 2026
- Contributing guide
- Contributing guide
- Code of conduct
- No code of conduct
- Beginner labels
- No beginner labels indexed
-
nvidia-runners
Difficulty 2/5 1-3 hours Newbie friendliness 25/100
NVIDIA-NeMo/Evaluator#1154 ·
-
community-request
Difficulty 4/5 3-5 days Newbie friendliness 55/100
NVIDIA-NeMo/Evaluator#1141 · 1 comment ·
-
community-request waiting-on-maintainers
Difficulty 4/5 3-5 days Newbie friendliness 48/100
NVIDIA-NeMo/Evaluator#1140 · 7 comments ·
-
bug community-request waiting-on-maintainers
Difficulty 1/5 Under an hour Newbie friendliness 82/100
NVIDIA-NeMo/Evaluator#1111 ·
-
XSTest loading fails Openbug community-request waiting-on-maintainers
Difficulty 2/5 1-3 hours Newbie friendliness 84/100
NVIDIA-NeMo/Evaluator#1110 ·
-
bug community-request waiting-on-maintainers
Difficulty 1/5 Under an hour Newbie friendliness 82/100
NVIDIA-NeMo/Evaluator#1109 ·
-
community-request waiting-on-maintainers
NVIDIA-NeMo/Evaluator#974 · 1 comment · 1 assignee ·
-
enhancement
NVIDIA-NeMo/Evaluator#279 · 12 comments · 1 assignee ·
-
support
NVIDIA-NeMo/Evaluator#49 · 4 comments · 1 assignee ·