huggingface / huggingface/lighteval
[FT] Caching
Open
feature
- Dominant language
- Python
- Stars
- 2.5k
- Forks
- 555
- Avg merge
- 1d 6h
- Merged PRs (30d)
- 1
Description
See [slack](https://huggingface.slack.com/archives/C055130UYQG/p1721995050911309)
Cache each task which finished to 1) avoid re-running it 2) restart evals which failed 3) avoid re-calling model as a judge when re-running
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.