huggingface / huggingface/diffusers
[Flux ControlNet] Add support for de-distilled models with CFG
- Vorherrschende Sprache
- Python
- Sterne
- 34.5k
- Forks
- 7.3k
- Ø Merge
- 3 T. 3 Std.
- Gemergte PRs (30 T.)
- 91
Beschreibung
Flux with Inpaiting and ControlNet currently yields bad result with the base model.
To echo [this comment](https://github.com/huggingface/diffusers/pull/9571#issuecomment-2404857656), using de-distilled models could potentially help getting better outputs.
Currently the Flux ControlNet pipelines do not support models like https://huggingface.co/nyanko7/flux-dev-de-distill
Beitragsleitfaden
Rechercherichtung
Start by locating the Flux ControlNet pipelines, especially the inpainting and ControlNet paths, and compare their model-loading and CFG handling with support for the referenced de-distilled model. Run the existing Flux ControlNet workflow with the nyanko7/flux-dev-de-distill model; done means the pipeline accepts it and produces valid improved outputs without breaking base-model behavior.
Vom Indexierungsmodell aus dem Issue-Text verfasst.
Bewertung
- Tech-Stack
- python, pytorch
- Bereich
- machine-learning
- Issue-Typ
- Feature
- Schwierigkeit
- 4/5
- Geschätzter Aufwand
- 3-5 Tage
- Aktivitätsstatus
- Aktiv
- Klarheit
- Größtenteils klar
- Anfängerfreundlichkeit
- 48/100