huggingface / huggingface/evaluate
Fix gradio widgets on the perplexity metric/measurement spaces
Open
- Dominant language
- Python
- Stars
- 2.5k
- Forks
- 341
- PR merge metrics
- No merged PRs in 30d
Description
This widget seems like it'd be useful for demonstration purposes but right now I'm unclear if it's broken or incomplete. I assume the rows in the columns data (measurement) and predictions (metric) should correspond to text which we want to measure perplexity on, but it's unclear what they should be right now / why it doesn't work.
Contributor guide
Assessment
This issue has not been assessed yet.