huggingface / huggingface/diffusers

[Community] Rectified-CFG++ pipelines for SD3/3.5, Flux, Lumina 2, Qwen-Image, and Wan

Abierto
#14,744 0 comentarios 0 reacciones 0 asignados Ver en GitHub
feature-request pipelines
Lenguaje dominante
Python
Estrellas
34.5k
Forks
7.3k
Merge medio
3 d 3 h
PR fusionados (30 d)
91

Descripción

### Feature request

Add community pipelines that sample rectified-flow models with Rectified-CFG++ (Saini, Gupta, Bovik; NeurIPS 2025): [paper](https://huggingface.co/papers/2510.07631), [reference implementation](https://github.com/shreshthsaini/Rectified-CFGpp).

Rectified-CFG++ is a training-free replacement for the classifier-free guidance extrapolation in flow samplers. Each ODE step becomes a predictor-corrector update: the predictor steps along the conditional velocity, the corrector evaluates the conditional and unconditional velocities at that predicted point, and the effective velocity is the conditional velocity at the current point plus the scaled corrector difference. High guidance scales keep prompt alignment without the over-saturation and structural artifacts of standard CFG. On SD3.5, Flux-dev, and Lumina-Image-2.0 the paper reports better FID, CLIP score, and ImageReward than CFG at the same number of steps.

### Why a community pipeline

The method needs a second model evaluation at the predicted point inside the step, so it does not fit the `guiders` API, which recombines predictions from a single evaluation. A community pipeline per backbone (generated from the upstream pipeline with only the denoising loop replaced) keeps everything else, LoRA, IP-Adapter, skip-layer guidance, callbacks, working unchanged. Happy to move to modular denoise blocks if maintainers prefer that route.

### Scope

Backbones from the paper: Stable Diffusion 3 / 3.5, Flux, Lumina-Image-2.0. Beyond the paper: Qwen-Image and Wan 2.1 / 2.2 (video), which use the same flow-matching sampling.

I am the first author of the paper. PR #14726 implements this; opening the issue for coordination as the contribution guide asks.

Guía de contribución

Abrir la guía de contribución

Línea de trabajo

Comienza revisando PR #14726 y las pipelines upstream que modifica; el issue identifica el bucle de denoising y la guiders API como los puntos de entrada relevantes. Compara las pipelines comunitarias propuestas para SD3/3.5, Flux, Lumina 2, Qwen-Image y Wan con el alcance indicado; se considera completado cuando el muestreo Rectified-CFG++ funciona en todos los backbones enumerados, mientras que LoRA, IP-Adapter, skip-layer guidance y los callbacks existentes permanecen sin cambios.

Escrito por el modelo de indexación a partir del texto del issue.

Evaluación

Stack tecnológico
python, pytorch
Área
machine-learning
Tipo de issue
Nueva funcionalidad
Dificultad
5/5
Tiempo estimado
Más de una semana
Estado de actividad
Estancado
Claridad
Bastante claro
Aptitud para principiantes
20/100

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.