huggingface / huggingface/model-evaluator
Allow model evaluations to be re-run
Open
- Dominant language
- Python
- Stars
- 14
- Forks
- 8
- Avg merge
- 34m
- Merged PRs (30d)
- 1
Description
If a model has been updated (e.g. with updated checkpoints) it'd be ideal to allow users to rerun evaluation. Right now model+data config combinations which have already been run are automatically filtered out.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.