huggingface / huggingface/sentence-transformers
How to use LabelAccuracyEvaluator.py
Open
- Dominant language
- Python
- Stars
- 19.1k
- Forks
- 2.9k
- Avg merge
- 1d 19h
- Merged PRs (30d)
- 61
Description
Hi, I'd like to evaluate the accuracy of AllNLI task during training. Could you kindly provide an example for that? Thank you!
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reading LabelAccuracyEvaluator.py and tracing how the AllNLI task is evaluated during training. A useful outcome would be a documented, reproducible example showing how to use the evaluator for AllNLI accuracy.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- documentation, machine-learning
- Issue type
- Documentation
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100