huggingface / huggingface/evaluate

Rouge-SU-4 (skipgram)

Open
#384 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2.5k
Forks
341
PR merge metrics
No merged PRs in 30d

Description

I was trying to migrate from https://github.com/tagucci/pythonrouge whose ROUGE-SU-4 has the highest variance on my summary evaluations (and so is an important metric in the PCA/eigenvector sense) but you don't provide it. Are there plans for it? Is there a reason why it wasn't or won't be implemented?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.