ByteDance-Seed / ByteDance-Seed/Bagel

Keep thinking ability after fine-tuning

Open
#231 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
6.2k
Forks
545
PR merge metrics
No merged PRs in 30d

Description

Hi authors,

Thanks for your great work again!
I'm wondering if the model can keep the thinking ability after fine-tuning, say 15k steps, only fine-tuned on T2I task.
Based on my current experiments, it seems not able to preseve the thinking ability and it will appear many 'vr
vr
vr
vr
vr' when I use generation with think. (no matter set freeze_und=True or False)

Do you think adding the I2T image to text task will preserve the think ability after fine-tuning?
Or What should I do if I want to keep thinking ability?

Thanks a lot!

Best,
Minghui

Contributor guide

No contributing guide indexed for this repository

Research direction

The report concerns fine-tuning for 15k steps on a T2I task, the freeze_und setting, and generation with think; no source files or tests are identified. Start by reviewing the fine-tuning and generation entry points, reproduce the repeated “vr” output, and compare behavior with and without the I2T task to establish what a fix or documented limitation would require.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.