Feature request: NoRepeatNgram
Open
backend
enhancement
- Dominant language
- Rust
- Stars
- 619
- Forks
- 74
- PR merge metrics
- No merged PRs in 30d
Description
Sometimes my model repeats a whole paragraph again and again endlessly. Would it be possible to ban repetition of specific ngram size, like this NoRepeatNgramLogitsProcessor from transformer https://huggingface.co/docs/transformers/v4.36.1/en/internal/generation_utils#transformers.NoRepeatNGramLogitsProcessor ?
Thanks.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.