huggingface / huggingface/lighteval

How to evaluate MMLU-Pro

Open
#1,028 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2.5k
Forks
555
Avg merge
1d 6h
Merged PRs (30d)
1

Description

Hi,

Thank you for the wonderful work!

I just want to ask how to perform the evaluation on MMLU-Pro, as I don't see any related code besides the README.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.