huggingface / huggingface/diffusers

[feature] implement TeaCache

Open
#12,589 13 comments 5 reactions 0 assignees Claimed by @LawJarp-A View on GitHub
contributions-welcome performance roadmap
Dominant language
Python
Stars
34.5k
Forks
7.3k
Avg merge
3d 3h
Merged PRs (30d)
91

Description

Currently, we support PAB and FasterCache. More details: https://huggingface.co/docs/diffusers/main/en/optimization/cache.

It'd be cool to support [Timestep Embedding Tells: It's Time to Cache for Video Diffusion Model](https://liewfeng.github.io/TeaCache/) as it's quite popular in the community. Code is here:
https://github.com/ali-vilab/TeaCache

Before proceeding with a PR, please propose a design first in this thread. We can take it from there.

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the existing PAB and FasterCache support, then study the linked TeaCache implementation and the design discussion in this issue. Propose an integration design in the thread before making changes; the work is complete when the design is accepted and TeaCache support is implemented and validated.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning, performance
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.