huggingface / huggingface/diffusers
[Flux ControlNet] Add support for de-distilled models with CFG
- Lenguaje dominante
- Python
- Estrellas
- 34.5k
- Forks
- 7.3k
- Merge medio
- 3 d 3 h
- PR fusionados (30 d)
- 91
Descripción
Flux with Inpaiting and ControlNet currently yields bad result with the base model.
To echo [this comment](https://github.com/huggingface/diffusers/pull/9571#issuecomment-2404857656), using de-distilled models could potentially help getting better outputs.
Currently the Flux ControlNet pipelines do not support models like https://huggingface.co/nyanko7/flux-dev-de-distill
Guía de contribución
Línea de trabajo
Start by locating the Flux ControlNet pipelines, especially the inpainting and ControlNet paths, and compare their model-loading and CFG handling with support for the referenced de-distilled model. Run the existing Flux ControlNet workflow with the nyanko7/flux-dev-de-distill model; done means the pipeline accepts it and produces valid improved outputs without breaking base-model behavior.
Escrito por el modelo de indexación a partir del texto del issue.
Evaluación
- Stack tecnológico
- python, pytorch
- Área
- machine-learning
- Tipo de issue
- Nueva funcionalidad
- Dificultad
- 4/5
- Tiempo estimado
- 3-5 días
- Estado de actividad
- Activo
- Claridad
- Bastante claro
- Aptitud para principiantes
- 48/100