huggingface / huggingface/diffusers

Elastic-DiT support

Open
#13,191 2 comments 2 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
34.5k
Forks
7.3k
Avg merge
3d 3h
Merged PRs (30d)
91

Description

### Model/Pipeline/Scheduler description

Elastic-DiT was released a few hours ago: https://github.com/wangjiangshan0725/Elastic-DiT

It's supposed to greatly accelerate (~2x speed) the diffusion process of 2D image generators like qwen image and Flux with little impact to the quality of the output. This project was leaded by the creator of Hunyuan3D who used it also for the image->3d model (but this is likely out of scope for the diffusers project as it doesn't support 3D generation).

The code is available in the Github repo, the model checkpoint is hosted on HuggingFace and the paper is available on Arxiv.

### Open source status

- [x] The model implementation is available.
- [x] The model weights are available (Only relevant if addition is not a scheduler).

### Provide useful links for the implementation

https://github.com/wangjiangshan0725/Elastic-DiT
https://github.com/wangjiangshan0725/Elastic-DiT/blob/65535c3671199b0e26e96d7493cdeb71b2bcf3d8/diffsynth/pipelines/qwen_image_elastic_dit.py
https://huggingface.co/wjs0725/Elastic-DiT

@wangjiangshan0725
@Zeqiang-Lai

Contributor guide

Open the contributing guide

Research direction

Start by reading the Elastic-DiT repository and its referenced diffsynth/pipelines/qwen_image_elastic_dit.py implementation, then inspect the Elastic-DiT checkpoint on Hugging Face. Determine the appropriate diffusers entry points and validation needed for Qwen Image and Flux support; done means the model is integrated and its output can be validated against the published implementation.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.