ByteDance-Seed / ByteDance-Seed/seed-oss
thinking_budget doesn`t work
- Dominant language
- Python
- Stars
- 891
- Forks
- 53
- PR merge metrics
- No merged PRs in 30d
Description
I use following method to post a request, however the response show the model is still thinking.
```python
data = {
"messages": [
{
"role": "user",
"content": prompt
}
],
"extra_body":{
"chat_template_kwargs": {
"thinking_budget": 0
}
}
}
model = "http://localhost:9476/v1/chat/completions"
out = requests.post(model, json=data).json()["choices"][0]["message"]["content"]
print(out)
```
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the Python requests reproduction against http://localhost:9476/v1/chat/completions and trace how extra_body.chat_template_kwargs is handled, especially thinking_budget=0. Verify the behavior with a minimal request and consider the issue done when the response no longer includes model thinking for that setting.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- ai, api
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 42/100