huggingface / huggingface/evaluate
does rouge_score = evaluate.load("rouge") support other languages?
Open
- Dominant language
- Python
- Stars
- 2.5k
- Forks
- 341
- PR merge metrics
- No merged PRs in 30d
Description
Hi all,
I am doing summarization tasks using rouge score which I found in https://huggingface.co/learn/nlp-course/chapter7/5?fw=pt :
```
!pip install rouge_score
import evaluate
rouge_score = evaluate.load("rouge")
scores = rouge_score.compute(
predictions=[generated_summary], references=[reference_summary]
)
```
But the scores for some languages are even 0 like Marathi or Bengali.
Does it support languages other than English?
if not, is there any method that I could use?
Thanks!
Contributor guide
Assessment
This issue has not been assessed yet.