explosion / explosion/spacy-llm
[Warning] the current text generation call will exceed the model's predefined maximum length (4096).
Open
feat/model
usage
- Dominant language
- Python
- Stars
- 1.4k
- Forks
- 110
- PR merge metrics
- No merged PRs in 30d
Description
When using LLM to do NER task, there is a warning saying "This is a friendly reminder - the current text generation call will exceed the model's predefined maximum length (4096). Depending on the model, you may observe exceptions, performance degradation, or nothing at all."
How to change the maximum length of the LLM output?
```
[components.llm.task]
@llm_tasks = "spacy.NER.v3"
[components.llm.model]
@llm_models = "spacy.Llama2.v1"
name = "Llama-2-7b-hf"
```
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.