huggingface/lighteval
View on GitHubLighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
- Stars
- 2.5k
- Forks
- 555
- Open beginner issues
- 1
- Indexed issues
- 233
- Avg merge
- 1d 6h
- Merged PRs (30d)
- 1
- Dominant language
- Python
- License
- MIT
- Last GitHub push
- Sep 9, 2026
- Latest indexed
- Sep 17, 2026
- Contributing guide
- No contributing guide
- Code of conduct
- No code of conduct
- Beginner labels
- good first issue help wanted
-
bug
huggingface/lighteval#460 · 0 comments · 1 reaction · 0 assignees ·
-
bug
huggingface/lighteval#462 · 0 comments · 0 reactions · 0 assignees ·
-
feature
huggingface/lighteval#474 · 0 comments · 0 reactions · 0 assignees ·
-
feature
huggingface/lighteval#478 · 0 comments · 0 reactions · 0 assignees ·
-
feature
huggingface/lighteval#482 · 0 comments · 0 reactions · 0 assignees ·
-
bug
huggingface/lighteval#487 · 0 comments · 0 reactions · 0 assignees ·
-
bug
huggingface/lighteval#492 · 3 comments · 0 reactions · 0 assignees ·
-
feature
huggingface/lighteval#496 · 0 comments · 0 reactions · 0 assignees ·
-
huggingface/lighteval#528 · 4 comments · 0 reactions · 0 assignees ·
-
feature good first issue help wanted
huggingface/lighteval#567 · 1 comment · 0 reactions · 0 assignees ·
-
huggingface/lighteval#569 · 0 comments · 0 reactions · 0 assignees ·
-
good first issue help wanted new-task
huggingface/lighteval#577 · 10 comments · 0 reactions · 0 assignees ·
-
feature
huggingface/lighteval#591 · 0 comments · 1 reaction · 0 assignees ·
-
good first issue help wanted new-task science-team
huggingface/lighteval#600 · 3 comments · 0 reactions · 0 assignees ·
-
bug
huggingface/lighteval#618 · 7 comments · 0 reactions · 0 assignees ·
-
bug
huggingface/lighteval#623 · 0 comments · 0 reactions · 0 assignees ·
-
feature good first issue help wanted
huggingface/lighteval#634 · 3 comments · 0 reactions · 0 assignees ·
-
bug
huggingface/lighteval#650 · 2 comments · 3 reactions · 0 assignees ·
-
bug
huggingface/lighteval#657 · 0 comments · 0 reactions · 0 assignees ·
-
bug
huggingface/lighteval#660 · 4 comments · 0 reactions · 0 assignees ·
-
feature help wanted science-team
huggingface/lighteval#662 · 1 comment · 0 reactions · 0 assignees ·
-
feature
huggingface/lighteval#681 · 6 comments · 0 reactions · 1 assignee ·
-
documentation feature good first issue help wanted
huggingface/lighteval#682 · 6 comments · 1 reaction · 0 assignees ·
-
[EVAL] Adding PHARE Opengood first issue help wanted new-task
huggingface/lighteval#696 · 9 comments · 0 reactions · 1 assignee ·
-
bug help wanted
huggingface/lighteval#713 · 1 comment · 1 reaction · 0 assignees ·
-
good first issue help wanted new-task
huggingface/lighteval#716 · 2 comments · 1 reaction · 0 assignees ·
-
feature
huggingface/lighteval#719 · 1 comment · 0 reactions · 0 assignees ·
-
feature
huggingface/lighteval#723 · 0 comments · 0 reactions · 2 assignees ·
-
feature good first issue
huggingface/lighteval#724 · 1 comment · 1 reaction · 1 assignee ·
-
new-task science-team
huggingface/lighteval#726 · 0 comments · 0 reactions · 1 assignee ·
-
help wanted new-task
huggingface/lighteval#730 · 0 comments · 0 reactions · 0 assignees ·
-
help wanted new-task
huggingface/lighteval#731 · 2 comments · 0 reactions · 0 assignees ·
-
bug good first issue help wanted science-team
huggingface/lighteval#732 · 1 comment · 0 reactions · 1 assignee ·
-
feature
huggingface/lighteval#735 · 0 comments · 0 reactions · 1 assignee ·
-
bug
huggingface/lighteval#737 · 1 comment · 0 reactions · 0 assignees ·
-
help wanted new-task
huggingface/lighteval#740 · 2 comments · 0 reactions · 0 assignees ·
-
[EVAL] TauBench: Openhelp wanted new-task
huggingface/lighteval#741 · 1 comment · 0 reactions · 0 assignees ·
-
bug
huggingface/lighteval#742 · 0 comments · 0 reactions · 0 assignees ·
-
feature good first issue
huggingface/lighteval#745 · 2 comments · 0 reactions · 0 assignees ·
-
feature ignore-for-release
huggingface/lighteval#747 · 1 comment · 0 reactions · 0 assignees ·
-
bug documentation
huggingface/lighteval#748 · 1 comment · 0 reactions · 0 assignees ·
-
feature
huggingface/lighteval#750 · 1 comment · 0 reactions · 0 assignees ·
-
bug science-team
huggingface/lighteval#751 · 0 comments · 0 reactions · 0 assignees ·
-
bug documentation feature
huggingface/lighteval#759 · 0 comments · 0 reactions · 0 assignees ·
-
bug documentation good first issue
huggingface/lighteval#760 · 5 comments · 0 reactions · 0 assignees ·
-
bug documentation
huggingface/lighteval#761 · 8 comments · 0 reactions · 0 assignees ·
-
huggingface/lighteval#763 · 4 comments · 0 reactions · 0 assignees ·
-
feature good first issue help wanted ignore-for-release
huggingface/lighteval#765 · 3 comments · 0 reactions · 0 assignees ·
-
bug
huggingface/lighteval#771 · 2 comments · 1 reaction · 0 assignees ·
-
bug
huggingface/lighteval#793 · 1 comment · 0 reactions · 0 assignees ·