huggingface / huggingface/diffusers

Differential Diffusion with ControlNet pipeline

Aperta
#9,186 4 commenti 0 reazioni 1 assegnatario Rivendicata da @asomoza Vedi su GitHub
stale
Lingua principale
Python
Stelle
34.5k
Fork
7.3k
Merge medio
3g 3h
PR unite (30g)
91

Descrizione

**Is your feature request related to a problem? Please describe.**
Many users have asked me whether diff diff goes well with ControlNet :
https://github.com/exx8/differential-diffusion/issues/29,
https://github.com/exx8/differential-diffusion/issues/19
It does!
I have conducted an experiment in the past, but it was with an old diffusion model (SD2).
I believe that ControlNet and diff diff can give yet to be seen control over image editing:
I tend to imagine it as diff diff control how far the inference process can go from the origin in a region, while ControlNet control to what direction.
So, it is expected to be quite powerful and useful.
The implementation is surprising straightforward, diff diff and ControlNet don't collide.
**Describe the solution you'd like.**
A user will be able to use both ControlNet and diff diff for the same inference process.

**Describe alternatives you've considered.**
Using diff diff alone or ControlNet alone is the only alternative I can think of. This won't get the same amount of control as the combination of both.

**Additional context.**
I can release my code if it will help, but it contains a little bug, and it is for an old version.

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.