huggingface / huggingface/evaluate

Question: Computing utterance-level and corpus level metrics

Open
#477 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2.5k
Forks
341
PR merge metrics
No merged PRs in 30d

Description

Is there a way to obtain utterance level and corpus level metrics simultaneously by default?

I want utterance-level metrics to do fine-grained analysis afterwards.

Would appreciate any pointers - thanks !

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.