huggingface / huggingface/optimum-benchmark
Evaluators for specific tasks
Open
enhancement
good first issue
- Dominant language
- Python
- Stars
- 341
- Forks
- 64
- Avg merge
- 58m
- Merged PRs (30d)
- 1
Description
@regisss would it make sense to add task specific evaluators. for example with `automatic-speech-recognition`, as I did it manually when I did whisper's benchmark.
Contributor guide
Assessment
This issue has not been assessed yet.