huggingface / huggingface/diffusers

FlowMatch schedulers - closing the gap

Open
#9,607 11 comments 0 reactions 1 assignee Claimed by @yiyixuxu View on GitHub
scheduler wip
Dominant language
Python
Stars
34.5k
Forks
7.3k
Avg merge
3d 3h
Merged PRs (30d)
91

Description

As stated [here](https://github.com/huggingface/diffusers/issues/9490#issuecomment-2369756363), lets close the scheduler gap!

Problem statement:
- Most (if not all quality ones) new models are DiT based
- Implementation of DiT based models in Diffusers typically requires Flow-match type schedulers
- Currently *only* working scheduler is `FlowMatchEulerDiscreteScheduler` which creates a massive gap!

(just for completeness, there is also an older implementation of `FlowMatchHeunDiscreteScheduler`, but its not updated to support required `set_timesteps` or `mu` inputs, so it cannot be used with newer DiT models like Flux.1)

on the other hand, ComfyUI allows use of any regular scheduler with DiT and does not require separate duplicate -FlowMatch variant of the same scheduler (e.g. *EulerDiscrete* vs *FlowMatchEulerDiscrete*) with Flux.1.

reference: matrix of different schedulers used with Flux.1.Dev via ComfyUI:

cc: @yiyixuxu @sayakpaul @DN6 @asomoza

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.