huggingface / huggingface/optimum-nvidia
Is there support for StoppingCriteria?
Open
enhancement
- Dominant language
- Python
- Stars
- 1k
- Forks
- 103
- Avg merge
- 2m
- Merged PRs (30d)
- 1
Description
for example
```python
outputs = pipeline(
prompt,
**self.generation_kwargs,
stopping_criteria=[StopAtSpaceToken(prompt_len, stop_tokens, flags)])
```
Where `StopAtSpaceToken` is a subclass of `StoppingCriteria`.
Contributor guide
Assessment
This issue has not been assessed yet.