huggingface / huggingface/diffusers

[New feature] A Noise Injection Method for Flux

Offen
#10,071 10 Kommentare 1 Reaktion 0 zugewiesene Personen Auf GitHub ansehen
consider-for-modular-diffusers wip
Vorherrschende Sprache
Python
Sterne
34.5k
Forks
7.3k
Ø Merge
3 T. 3 Std.
Gemergte PRs (30 T.)
91

Beschreibung

### New Feature for FluxPipeline
Paper: [Link](https://openreview.net/pdf?id=KzokzKV4JK)
Code : [Link](https://anonymous.4open.science/r/SSNI-F746/README.md)
workflow : [Link](https://www.dropbox.com/scl/fi/hhitjx6lqpqpv8xjx9ikq/Flux-Noise-Injection.json?rlkey=45xnu45j1i5owiwhc7z1hppn1&e=1&dl=0)
This paper introduces Sample-specific Score-aware Noise Injection (SSNI) to improve diffusion-based purification (DBP) methods. Unlike existing approaches that use a fixed noise level (t*) for all samples, SSNI adapts t* based on how noisy or clean each sample is. Using a pre-trained score network, SSNI estimates a sample's deviation from the clean data and adjusts the noise level accordingly.

This have stunning Results with Flux

![spider_with_noise_injection](https://github.com/user-attachments/assets/e87d3da6-6ff5-46c1-b0ff-20c00ad4e541)
![spider_sh](https://github.com/user-attachments/assets/e0f7a469-ae99-4095-9c9d-8cc88ed4691d)

@sayakpaul @yiyixuxu

Beitragsleitfaden

Beitragsleitfaden öffnen

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.