huggingface / huggingface/lighteval
[BUG] Error in lighteval/metrics/metrics_sample.py:513: _rouge_score_with_bootsrap, invalid argument
- Dominant language
- Python
- Stars
- 2.5k
- Forks
- 555
- Avg merge
- 1d 6h
- Merged PRs (30d)
- 1
Description
│ /home/lzc/.conda/envs/eval/lib/python3.11/site-packages/lighteval/metrics/metrics_sample.py:513 in compute │
│ │
│ 510 │ │ │ predictions = [self.normalize_pred(p) for p in predictions] │
│ 511 │ │ │
│ 512 │ │ if self.bootstrap: # For t5 style rouge score │
│ ❱ 513 │ │ │ scores = self._rouge_score_with_bootsrap(golds=golds, predictions=prediction │
│ 514 │ │ elif self.multiple_golds: │
│ 515 │ │ │ scores = self._rouge_score_multi_golds(golds=golds, preds=predictions) │
│ 516 │ │ else: │
╰───────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────────╯
TypeError: ROUGE._rouge_score_with_bootsrap() got an unexpected keyword argument 'predictions'
Please change the `predictions` in row 513 to `preds`
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.