huggingface / huggingface/diffusers

[New Pipeline]: SmoothCache: A Universal Inference Acceleration Technique for Diffusion Transformers

Open
#11,135 4 comments 0 reactions 0 assignees View on GitHub
stale
Dominant language
Python
Stars
34.5k
Forks
7.3k
Avg merge
3d 3h
Merged PRs (30d)
91

Description

### Model/Pipeline/Scheduler description

Repo: https://github.com/Roblox/SmoothCache
Paper: https://huggingface.co/papers/2411.10510

This is a training-free acceleration technique for DiT pipelines, that controls caching behavior of individual components and works across different pipelines and modalities.

There is a non-intrusive helper class implemented for plug-and-play integration with Diffusers DiT Pipeline. No changes inside Diffusers needed for this to work.

We're happy to add SmoothCache in the form of a doc-only PR to benefit a broader user-base.

### Open source status

- [x] The model implementation is available.
- [ ] The model weights are available (Only relevant if addition is not a scheduler).

### Provide useful links for the implementation

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.