Add max_tokens as allowed modelOption
Open
- Dominant language
- TypeScript
- Stars
- 193k
- Forks
- 42.4k
- PR merge metrics
- PR metrics pending
Description
In `chatLanguageModels.json` I would like to configure `max_tokens` in `modelOptions` to fix the max_tokens for chat calls. At the moment no value is sent. In Cooperate environments the default `max_tokens` may be small. This leads at the moment to stripped answers without a possibility to change the option.
Contributor guide
Assessment
This issue has not been assessed yet.