huggingface / huggingface/chat-ui
Feature Request: add precise/balanced/creative toggle button
Open
enhancement
- Dominant language
- TypeScript
- Stars
- 11k
- Forks
- 1.7k
- Avg merge
- 21h 24m
- Merged PRs (30d)
- 56
Description
Instead each model have its own config temperature, add option to set temperature/top-p etc by selecting precise/balanced/creative toggle button.
It would be great because there is no single temperature that can fit all usecases.
I think it be be great that this can be enabled/disables using the .env by using new field "CREATIVENESS_TOGGLE_ENABLED=false/true" or it would be configured under the models section by adding "CREATIVENESS": {"precise": {"top-p":0.2," temp":0.1}, "balaned: ....}
Thanks ahead
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.