huggingface / huggingface/diffusers
Elastic-DiT support
- Dominant language
- Python
- Stars
- 34.5k
- Forks
- 7.3k
- Avg merge
- 3d 3h
- Merged PRs (30d)
- 91
Description
### Model/Pipeline/Scheduler description
Elastic-DiT was released a few hours ago: https://github.com/wangjiangshan0725/Elastic-DiT
It's supposed to greatly accelerate (~2x speed) the diffusion process of 2D image generators like qwen image and Flux with little impact to the quality of the output. This project was leaded by the creator of Hunyuan3D who used it also for the image->3d model (but this is likely out of scope for the diffusers project as it doesn't support 3D generation).
The code is available in the Github repo, the model checkpoint is hosted on HuggingFace and the paper is available on Arxiv.
### Open source status
- [x] The model implementation is available.
- [x] The model weights are available (Only relevant if addition is not a scheduler).
### Provide useful links for the implementation
https://github.com/wangjiangshan0725/Elastic-DiT
https://github.com/wangjiangshan0725/Elastic-DiT/blob/65535c3671199b0e26e96d7493cdeb71b2bcf3d8/diffsynth/pipelines/qwen_image_elastic_dit.py
https://huggingface.co/wjs0725/Elastic-DiT
@wangjiangshan0725
@Zeqiang-Lai
Contributor guide
Research direction
Start by reading the Elastic-DiT repository and its referenced diffsynth/pipelines/qwen_image_elastic_dit.py implementation, then inspect the Elastic-DiT checkpoint on Hugging Face. Determine the appropriate diffusers entry points and validation needed for Qwen Image and Flux support; done means the model is integrated and its output can be validated against the published implementation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100