huggingface / huggingface/lighteval

[BUG] Error in lighteval/metrics/metrics_sample.py:513: _rouge_score_with_bootsrap, invalid argument

Open
#854 0 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Python
Stars
2.5k
Forks
555
Avg merge
1d 6h
Merged PRs (30d)
1

Description

│ /home/lzc/.conda/envs/eval/lib/python3.11/site-packages/lighteval/metrics/metrics_sample.py:513 in compute │
│ │
│ 510 │ │ │ predictions = [self.normalize_pred(p) for p in predictions] │
│ 511 │ │ │
│ 512 │ │ if self.bootstrap: # For t5 style rouge score │
│ ❱ 513 │ │ │ scores = self._rouge_score_with_bootsrap(golds=golds, predictions=prediction │
│ 514 │ │ elif self.multiple_golds: │
│ 515 │ │ │ scores = self._rouge_score_multi_golds(golds=golds, preds=predictions) │
│ 516 │ │ else: │
╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
TypeError: ROUGE._rouge_score_with_bootsrap() got an unexpected keyword argument 'predictions'

Please change the `predictions` in row 513 to `preds`

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.