huggingface / huggingface/setfit
Same acc, recall, precision, f1 when it comes to trainer.evaluate()
Open
- Dominant language
- Jupyter Notebook
- Stars
- 2.8k
- Forks
- 267
- Avg merge
- 36m
- Merged PRs (30d)
- 5
Description
trainer.evaluate(eval_dataset=encoded_test_dataset)
output is
{'eval_loss': 0.6165900230407715,
'eval_precision': 0.681265206812652,
'eval_recall': 0.681265206812652,
'eval_f1': 0.681265206812652,
'eval_accuracy': 0.681265206812652,
'eval_runtime': 2.1712,
'eval_samples_per_second': 189.3,
'eval_steps_per_second': 5.988,
'epoch': 18.72}
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.