huggingface / huggingface/diffusers
Differential Diffusion with ControlNet pipeline
- Vorherrschende Sprache
- Python
- Sterne
- 34.5k
- Forks
- 7.3k
- Ø Merge
- 3 T. 3 Std.
- Gemergte PRs (30 T.)
- 91
Beschreibung
**Is your feature request related to a problem? Please describe.**
Many users have asked me whether diff diff goes well with ControlNet :
https://github.com/exx8/differential-diffusion/issues/29,
https://github.com/exx8/differential-diffusion/issues/19
It does!
I have conducted an experiment in the past, but it was with an old diffusion model (SD2).
I believe that ControlNet and diff diff can give yet to be seen control over image editing:
I tend to imagine it as diff diff control how far the inference process can go from the origin in a region, while ControlNet control to what direction.
So, it is expected to be quite powerful and useful.
The implementation is surprising straightforward, diff diff and ControlNet don't collide.
**Describe the solution you'd like.**
A user will be able to use both ControlNet and diff diff for the same inference process.
**Describe alternatives you've considered.**
Using diff diff alone or ControlNet alone is the only alternative I can think of. This won't get the same amount of control as the combination of both.
**Additional context.**
I can release my code if it will help, but it contains a little bug, and it is for an old version.
Beitragsleitfaden
Bewertung
Dieses Issue wurde noch nicht bewertet.