huggingface / huggingface/evaluate

Fix gradio widgets on the perplexity metric/measurement spaces

Open
#243 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2.5k
Forks
341
PR merge metrics
No merged PRs in 30d

Description

This widget seems like it'd be useful for demonstration purposes but right now I'm unclear if it's broken or incomplete. I assume the rows in the columns data (measurement) and predictions (metric) should correspond to text which we want to measure perplexity on, but it's unclear what they should be right now / why it doesn't work.

Screen Shot 2022-08-10 at 4 02 31 PM

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.