huggingface / huggingface/diffusers
Differential Diffusion with ControlNet pipeline
- Lingua principale
- Python
- Stelle
- 34.5k
- Fork
- 7.3k
- Merge medio
- 3g 3h
- PR unite (30g)
- 91
Descrizione
**Is your feature request related to a problem? Please describe.**
Many users have asked me whether diff diff goes well with ControlNet :
https://github.com/exx8/differential-diffusion/issues/29,
https://github.com/exx8/differential-diffusion/issues/19
It does!
I have conducted an experiment in the past, but it was with an old diffusion model (SD2).
I believe that ControlNet and diff diff can give yet to be seen control over image editing:
I tend to imagine it as diff diff control how far the inference process can go from the origin in a region, while ControlNet control to what direction.
So, it is expected to be quite powerful and useful.
The implementation is surprising straightforward, diff diff and ControlNet don't collide.
**Describe the solution you'd like.**
A user will be able to use both ControlNet and diff diff for the same inference process.
**Describe alternatives you've considered.**
Using diff diff alone or ControlNet alone is the only alternative I can think of. This won't get the same amount of control as the combination of both.
**Additional context.**
I can release my code if it will help, but it contains a little bug, and it is for an old version.
Guida per i contributori
Apri la guida per i contributori
Valutazione
Questa issue non è ancora stata valutata.