JetBrains-Research / JetBrains-Research/codegen-metrics
BLEU component in RUBY, CodeBLEU
Open
- Dominant language
- Jupyter Notebook
- Stars
- 17
- Forks
- 1
- PR merge metrics
- No merged PRs in 30d
Description
Thanks for sharing metric implementations!
Usually BLEU is computed on a corpus, not individual sentences.
Maybe it's not problem at all for metric like RUBY or CodeBLEU.
But BLEU component will have another values - micro-average vs. macro-average.
Anyway I think you have already noticed this difference: https://github.com/JetBrains-Research/codegen-metrics/blob/4b8ffd71d87a86854085a9e3179c6847d0d7efc0/metrics_evaluation/metrics/codebleu/codebleu.py#L304
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.