huggingface / huggingface/evaluate
Progress bar when using evaluator
Open
- Dominant language
- Python
- Stars
- 2.5k
- Forks
- 341
- PR merge metrics
- No merged PRs in 30d
Description
Currently, when using evaluator.compute, there is no indication of the process and no good way to wrap tqdm around it.
I suggest give an option in compute so that the progress bar can be shown, i.e.
task_evaluator = evaluator("image-classification")
eval_results = task_evaluator.compute(
model_or_pipeline=pipe,
data=dataset,
metric=metric,
label_mapping= lm,
device=0,
**progress_bar = True**
)
Please let me know if there are any potential concerns related!
Contributor guide
Assessment
This issue has not been assessed yet.