huggingface / huggingface/evaluate

does rouge_score = evaluate.load("rouge") support other languages?

Open
#464 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2.5k
Forks
341
PR merge metrics
No merged PRs in 30d

Description

Hi all,
I am doing summarization tasks using rouge score which I found in https://huggingface.co/learn/nlp-course/chapter7/5?fw=pt :
```
!pip install rouge_score

import evaluate

rouge_score = evaluate.load("rouge")
scores = rouge_score.compute(
predictions=[generated_summary], references=[reference_summary]
)
```
But the scores for some languages are even 0 like Marathi or Bengali.
Does it support languages other than English?
if not, is there any method that I could use?

Thanks!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.