huggingface / huggingface/evaluate
Can't load exist dataset for evaluation
- Dominant language
- Python
- Stars
- 2.5k
- Forks
- 341
- PR merge metrics
- No merged PRs in 30d
Description
Hi, I used `dair-ai/emotion` to fine-tune the `bert-base-cased` model to use it for text-classification task.
The dataset is loaded when I load it in this script, so there is no problem up to here:
```python
from datasets import load_dataset
dataset = load_dataset("dair-ai/emotion")
```
But in the evaluation script here:
```python
import numpy as np
import evaluate
predictions = trainer.predict(eval_dataset)
preds = np.argmax(predictions.predictions, axis=-1)
metric = evaluate.load("dair-ai/emotion")
metric.compute(predictions=preds, references=predictions.label_ids)
```
I got: **FileNotFoundError**: Couldn't find a module script at /content/dair-ai/emotion/emotion.py. **Module 'dair-ai/emotion' doesn't exist on the Hugging Face Hub either.**
I tried to find out the reason but did not find the solution.
Contributor guide
Assessment
This issue has not been assessed yet.