linkedin / linkedin/Liger-Kernel
Request to support the Flux model (T2I diffusion transformer)
Open
@saurabhkoshatwar is already working on this.
Since Nov 1, 2024.
feature
- Dominant language
- Python
- Stars
- 6.6k
- Forks
- 603
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 47
Description
### 🚀 The feature, motivation and pitch
This request is to adapt this to improve the training speed of Flux, a diffusion transformer.
It's the top model on HuggingFace trending right now and has been for two weeks, but it's very difficult to train as it's 12B parameters. The methods will also be useful for other ViT and DiT models in multimodal uses.
https://huggingface.co/black-forest-labs/FLUX.1-dev
https://github.com/huggingface/diffusers/blob/main/src/diffusers/models/transformers/transformer_flux.py
### Alternatives
_No response_
### Additional context
_No response_
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.