FormulaMonks/llm-benchmarker-suite

LLM Evals Leaderboard

Stars: 49
Forks: 6
Open beginner issues: 0
Indexed issues: 4

Dominant language: Python
License: MIT
Last GitHub push: Nov 21, 2023
Latest indexed: Sep 16, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed
PR merge metrics: No merged PRs in 30d

Open All

4 open issues indexed

What metrics are used to reproduce the evaluation in the leaderboards? Open

FormulaMonks/llm-benchmarker-suite#9 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Any arxiv paper or report? Open

FormulaMonks/llm-benchmarker-suite#11 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Is there a unified name for the leaderboard? Open

FormulaMonks/llm-benchmarker-suite#12 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
opencompass tagged version is not available, failing install Open

FormulaMonks/llm-benchmarker-suite#13 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026

A short digest of beginner-friendly GitHub issues.