ByteDance-Seed / ByteDance-Seed/Bagel
Whether a Sample is Involved in Either Understanding Loss Calculation or Generation Loss Calculation
- Dominant language
- Python
- Stars
- 6.2k
- Forks
- 545
- PR merge metrics
- No merged PRs in 30d
Description
Hello, although the packed batch contains samples from different categories (e.g., t2i_pretrain, vlm_sft, unified_edit), the attention mask separates these samples. Therefore, each sample undergoes either understanding loss calculation or generation loss calculation, but not both.
Contributor guide
No contributing guide indexed for this repository
Research direction
No source files, tests, or entry points are named. Start by locating the packed-batch attention-mask and understanding/generation-loss paths; done would require resolving whether each sample contributes to only one loss, but the issue does not define a code change or acceptance test.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100