ByteDance-Seed / ByteDance-Seed/Bagel

Whether a Sample is Involved in Either Understanding Loss Calculation or Generation Loss Calculation

Open
#213 4 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
6.2k
Forks
545
PR merge metrics
No merged PRs in 30d

Description

Hello, although the packed batch contains samples from different categories (e.g., t2i_pretrain, vlm_sft, unified_edit), the attention mask separates these samples. Therefore, each sample undergoes either understanding loss calculation or generation loss calculation, but not both.

Contributor guide

No contributing guide indexed for this repository

Research direction

No source files, tests, or entry points are named. Start by locating the packed-batch attention-mask and understanding/generation-loss paths; done would require resolving whether each sample contributes to only one loss, but the issue does not define a code change or acceptance test.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.