huggingface / huggingface/diffusers
Difference between Controlnet inpainting for SD2 and SD3
- Dominant language
- Python
- Stars
- 34.5k
- Forks
- 7.3k
- Avg merge
- 3d 3h
- Merged PRs (30d)
- 91
Description
Firstly great work with adding SD3 support on diffusers!
I was trying to run the SD3 controlnet inpainting script : [https://github.com/huggingface/diffusers/blob/main/src/diffusers/pipelines/controlnet_sd3/pipeline_stable_diffusion_3_controlnet_inpainting.py](https://github.com/huggingface/diffusers/blob/main/src/diffusers/pipelines/controlnet_sd3/pipeline_stable_diffusion_3_controlnet_inpainting.py) and realized that its doesn't have the concept of an init_image like [https://github.com/huggingface/diffusers/blob/main/src/diffusers/pipelines/controlnet/pipeline_controlnet_inpaint.py](https://github.com/huggingface/diffusers/blob/main/src/diffusers/pipelines/controlnet/pipeline_controlnet_inpaint.py).
I want to inpaint part of an image using a canny edge image (as my control). How would I do this in SD3?
Thanks in advance!
Contributor guide
Assessment
This issue has not been assessed yet.