ByteDance-Seed / ByteDance-Seed/seed-oss

thinking_budget doesn`t work

Open
#12 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
891
Forks
53
PR merge metrics
No merged PRs in 30d

Description

I use following method to post a request, however the response show the model is still thinking.
```python
data = {
"messages": [
{
"role": "user",
"content": prompt
}
],
"extra_body":{
"chat_template_kwargs": {
"thinking_budget": 0
}
}
}

model = "http://localhost:9476/v1/chat/completions"

out = requests.post(model, json=data).json()["choices"][0]["message"]["content"]
print(out)
```

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the Python requests reproduction against http://localhost:9476/v1/chat/completions and trace how extra_body.chat_template_kwargs is handled, especially thinking_budget=0. Verify the behavior with a minimal request and consider the issue done when the response no longer includes model thinking for that setting.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
ai, api
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.