huggingface / huggingface/diffusers
Wan i2i with latent upscale
- Lingua principale
- Python
- Stelle
- 34.5k
- Fork
- 7.3k
- Merge medio
- 3g 3h
- PR unite (30g)
- 91
Descrizione
### Model/Pipeline/Scheduler description
I made a wan i2i pipeline that can also somewhat handle upscaling (not really a true upscaler since it's very creative). It only uses the low noise transformer and can generate good results in 20 steps. It's useful to transform low quality pictures and to change the overall vibe of the composition leveraging the low noise transformer in Wan to add details.
A few examples:
* small upscale, simple mood change: https://1nf.sh/tasks/30dt0n0npdx5fa434cpryfs7je
* 5x upscale from low res (200px) : https://1nf.sh/tasks/19t5ah8bf27y8fqwsdyh058hz4
### Open source status
- [x] The model implementation is available.
- [x] The model weights are available (Only relevant if addition is not a scheduler).
### Provide useful links for the implementation
Not really sure there is appetite to have it in diffusers but in case code is here if you want to play with it https://gist.github.com/luke14free/33365d5fc4ffc1b83e18a5d0c4094b1a - its not perfect especially at low noise strengths & high scales & low cfg (it's not a good upscaler unless you allow it to be creative). If you happen to try it, feedback on the implementation is also appreciated, especially around those low strengths.
Guida per i contributori
Apri la guida per i contributori
Direzione di ricerca
Start by reviewing the linked implementation gist and its examples; the issue does not identify a repository file, test, or entry point. Determine whether the Wan image-to-image and latent-upscale behavior fits diffusers, clarify the expected scope and low-noise behavior, and define validation criteria before implementation.
Scritto dal modello di indicizzazione a partire dal testo della issue.
Valutazione
- Stack tecnologico
- python, pytorch
- Ambito
- machine-learning
- Tipo di issue
- Funzionalità
- Difficoltà
- 5/5
- Tempo stimato
- Più di una settimana
- Stato di attività
- Ferma
- Chiarezza
- Da chiarire
- Idoneità per principianti
- 25/100