ByteDance-Seed / ByteDance-Seed/Bagel
About Training framework of Bagel
Open
- Dominant language
- Python
- Stars
- 6.2k
- Forks
- 545
- PR merge metrics
- No merged PRs in 30d
Description
Hi. Do you plan to open-source the Bagel training script that uses DeepSpeed? FSDP is throwing some GPU-memory or communication errors on 80 GB A800.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reviewing the Bagel training framework and the issue's references to DeepSpeed and FSDP. Confirm whether a DeepSpeed-based training script is planned and whether the reported GPU-memory or communication errors have a documented reproduction or workaround; done would be a clear maintainer decision or published training guidance.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- distributed-systems, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100