ByteDance-Seed / ByteDance-Seed/Bagel
<think> and </think> usage during inference
- Dominant language
- Python
- Stars
- 6.2k
- Forks
- 545
- PR merge metrics
- No merged PRs in 30d
Description
Hello,
I noticed that during inference the reasoning outputs are wrapped with and .
However, from reading the code I don’t see any place where these tags are added as special tokens in the tokenizer.
My questions are:
• Are and actually registered as special tokens in the model/tokenizer?
• Or are they just plain text strings used to structure the model’s output, without being treated differently from normal tokens?
I want to confirm whether these tags are part of the tokenizer’s vocabulary or simply a formatting convention applied to the generated text.
Thanks!
Contributor guide
No contributing guide indexed for this repository
Research direction
No file, test, or entry point is named. Start by tracing the tokenizer configuration and inference output handling, then determine whether the tags are registered tokens or plain generated text. Done means documenting a clear answer to both questions, with the relevant code locations identified.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Documentation
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100