ByteDance-Seed / ByteDance-Seed/Bagel

<think> and </think> usage during inference

Open
#238 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
6.2k
Forks
545
PR merge metrics
No merged PRs in 30d

Description

Hello,

I noticed that during inference the reasoning outputs are wrapped with and .
However, from reading the code I don’t see any place where these tags are added as special tokens in the tokenizer.

My questions are:
• Are and actually registered as special tokens in the model/tokenizer?
• Or are they just plain text strings used to structure the model’s output, without being treated differently from normal tokens?

I want to confirm whether these tags are part of the tokenizer’s vocabulary or simply a formatting convention applied to the generated text.

Thanks!

Contributor guide

No contributing guide indexed for this repository

Research direction

No file, test, or entry point is named. Start by tracing the tokenizer configuration and inference output handling, then determine whether the tags are registered tokens or plain generated text. Done means documenting a clear answer to both questions, with the relevant code locations identified.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.