atulkum / atulkum/pointer_summarizer

The low rouge scole

Open
#27 3 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
909
Forks
235
PR merge metrics
No merged PRs in 30d

Description

Hello,
Thanks for your valuable code. I have a question. When I run the code for 500k iterations. I get the rouge result:
ROUGE-1:
rouge_1_f_score: 0.2648 with confidence interval (0.2574, 0.2725)
rouge_1_recall: 0.3672 with confidence interval (0.3572, 0.3771)
rouge_1_precision: 0.2162 with confidence interval (0.2095, 0.2229)

ROUGE-2:
rouge_2_f_score: 0.0944 with confidence interval (0.0881, 0.1005)
rouge_2_recall: 0.1315 with confidence interval (0.1227, 0.1396)
rouge_2_precision: 0.0772 with confidence interval (0.0717, 0.0824)

ROUGE-l:
rouge_l_f_score: 0.2348 with confidence interval (0.2277, 0.2419)
rouge_l_recall: 0.3249 with confidence interval (0.3149, 0.3346)
rouge_l_precision: 0.1920 with confidence interval (0.1854, 0.1980)

So, Can you help me ? Thanks a lot.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.