huggingface / huggingface/diffusers

FlowMatch schedulers - closing the gap

Aperta
#9,607 11 commenti 0 reazioni 1 assegnatario Rivendicata da @yiyixuxu Vedi su GitHub
scheduler wip
Lingua principale
Python
Stelle
34.5k
Fork
7.3k
Merge medio
3g 3h
PR unite (30g)
91

Descrizione

As stated [here](https://github.com/huggingface/diffusers/issues/9490#issuecomment-2369756363), lets close the scheduler gap!

Problem statement:
- Most (if not all quality ones) new models are DiT based
- Implementation of DiT based models in Diffusers typically requires Flow-match type schedulers
- Currently *only* working scheduler is `FlowMatchEulerDiscreteScheduler` which creates a massive gap!

(just for completeness, there is also an older implementation of `FlowMatchHeunDiscreteScheduler`, but its not updated to support required `set_timesteps` or `mu` inputs, so it cannot be used with newer DiT models like Flux.1)

on the other hand, ComfyUI allows use of any regular scheduler with DiT and does not require separate duplicate -FlowMatch variant of the same scheduler (e.g. *EulerDiscrete* vs *FlowMatchEulerDiscrete*) with Flux.1.

reference: matrix of different schedulers used with Flux.1.Dev via ComfyUI:

cc: @yiyixuxu @sayakpaul @DN6 @asomoza

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.