huggingface / huggingface/diffusers

Help us profile important pipelines and improve if needed

Aperta
#13,401 42 commenti 2 reazioni 0 assegnatari Vedi su GitHub
diffusers-mvp performance
Lingua principale
Python
Stelle
34.5k
Fork
7.3k
Merge medio
3g 3h
PR unite (30g)
91

Descrizione

In https://github.com/huggingface/diffusers/pull/13356, we added a guide to comprehensively profile our pipelines with Claude. It, in turn, helped us get rid of issues that can get in the way of the benefits provided by `torch.compile`.

We cannot profile all our important pipelines alone, and this is where the community could really help us! In this thread, we want to gather interest from our community for such an initiative.

## How to take part?

* Take a pipeline of your choice (start with T2I or T2V first, as it's simpler than others). Then discuss with us here to gauge feasibility (not all pipelines are equally widely used). Tag `dg845` and `sayakpaul` while discussing.
* If there's mutual agreement, profile the pipeline following the steps outlined in the [guide](https://github.com/huggingface/diffusers/tree/main/examples/profiling).
* If there are fixes to be made, open a PR to ship the fixes. Also, include the results before and after those fixes.

## PRs merged with profiling-guided improvements

* QwenImage: https://github.com/huggingface/diffusers/pull/13406
* Z-Image: https://github.com/huggingface/diffusers/pull/13461
* LTX2: https://github.com/huggingface/diffusers/pull/13564

## PRs in progress

* None for now

## Pipelines worth profiling further

* QwenImage Edit
* SD3
* Flux.1-Kontext
* Ernie-Image
* Chroma
* JoyImage

Feel free to suggest yours, too!

Cc: @dg845

Guida per i contributori

Apri la guida per i contributori

Direzione di ricerca

Inizia leggendo la guida in examples/profiling e analizza le pipeline candidate elencate, cominciando con una pipeline T2I o T2V. Discuti la pipeline selezionata con dg845 e sayakpaul prima di eseguirne il profiling. Il lavoro è considerato completato quando fornisci i risultati del profiling prima e dopo e apri una PR per qualsiasi fix identificato.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Valutazione

Stack tecnologico
python, pytorch
Ambito
machine-learning, performance
Tipo di issue
Refactoring
Difficoltà
5/5
Tempo stimato
Più di una settimana
Stato di attività
Attiva
Chiarezza
Da chiarire
Idoneità per principianti
35/100

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.