ByteDance-Seed / ByteDance-Seed/Bagel
TeaCache for the Flow matching part to accelerate it 2x+
- Dominant language
- Python
- Stars
- 6.2k
- Forks
- 545
- PR merge metrics
- No merged PRs in 30d
Description
As the model uses Flow matching for decoding, it's theoretically possible to integrate TeaCache into it and get ~2x speedup.
TeaCache is opensourced and has a paper https://github.com/ali-vilab/TeaCache
Although, it its written about the timestep embedding there, the inputs in principle can be the bare input values as well
Currently, a generation of a picture takes 5 minutes on my single 4090, and it will much help to accelerate the process
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by locating the Flow matching decoding path in the Bagel repository, then read the linked TeaCache implementation and paper. The issue names no files or tests, so first establish where caching inputs can be integrated and how generation speed is measured. Done means a working integration with a measured speedup for image generation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning, performance
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100