huggingface / huggingface/setfit

Same acc, recall, precision, f1 when it comes to trainer.evaluate()

Open
#419 1 comment 1 reaction 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
2.8k
Forks
267
Avg merge
36m
Merged PRs (30d)
5

Description

trainer.evaluate(eval_dataset=encoded_test_dataset)

output is

{'eval_loss': 0.6165900230407715,
'eval_precision': 0.681265206812652,
'eval_recall': 0.681265206812652,
'eval_f1': 0.681265206812652,
'eval_accuracy': 0.681265206812652,
'eval_runtime': 2.1712,
'eval_samples_per_second': 189.3,
'eval_steps_per_second': 5.988,
'epoch': 18.72}

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.