huggingface / huggingface/diffusers

Wan i2i with latent upscale

Aperta
#12,173 1 commento 1 reazione 0 assegnatari Vedi su GitHub
stale
Lingua principale
Python
Stelle
34.5k
Fork
7.3k
Merge medio
3g 3h
PR unite (30g)
91

Descrizione

### Model/Pipeline/Scheduler description

I made a wan i2i pipeline that can also somewhat handle upscaling (not really a true upscaler since it's very creative). It only uses the low noise transformer and can generate good results in 20 steps. It's useful to transform low quality pictures and to change the overall vibe of the composition leveraging the low noise transformer in Wan to add details.

A few examples:

* small upscale, simple mood change: https://1nf.sh/tasks/30dt0n0npdx5fa434cpryfs7je
* 5x upscale from low res (200px) : https://1nf.sh/tasks/19t5ah8bf27y8fqwsdyh058hz4

### Open source status

- [x] The model implementation is available.
- [x] The model weights are available (Only relevant if addition is not a scheduler).

### Provide useful links for the implementation

Not really sure there is appetite to have it in diffusers but in case code is here if you want to play with it https://gist.github.com/luke14free/33365d5fc4ffc1b83e18a5d0c4094b1a - its not perfect especially at low noise strengths & high scales & low cfg (it's not a good upscaler unless you allow it to be creative). If you happen to try it, feedback on the implementation is also appreciated, especially around those low strengths.

Guida per i contributori

Apri la guida per i contributori

Direzione di ricerca

Start by reviewing the linked implementation gist and its examples; the issue does not identify a repository file, test, or entry point. Determine whether the Wan image-to-image and latent-upscale behavior fits diffusers, clarify the expected scope and low-noise behavior, and define validation criteria before implementation.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Valutazione

Stack tecnologico
python, pytorch
Ambito
machine-learning
Tipo di issue
Funzionalità
Difficoltà
5/5
Tempo stimato
Più di una settimana
Stato di attività
Ferma
Chiarezza
Da chiarire
Idoneità per principianti
25/100

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.