huggingface / huggingface/evaluate
Add semantic similarity evaluator
Open
enhancement
- Dominant language
- Python
- Stars
- 2.5k
- Forks
- 341
- PR merge metrics
- No merged PRs in 30d
Description
Needed for tasks like `glue/mrpc`, with a default to cosine similarity.
Tasks in this format (will be updating this as I go along): mrpc, quora question pairs (qqp), sst/sst2
Contributor guide
Assessment
This issue has not been assessed yet.