huggingface / huggingface/diffusers

Improve support of Reference-only and outpainting for SDXL

Abierto
#4,257 22 comentarios 16 reacciones 1 asignado Reclamado por @DN6 Ver en GitHub
community-examples New pipeline/model wip
Lenguaje dominante
Python
Estrellas
34.5k
Forks
7.3k
Merge medio
3 d 3 h
PR fusionados (30 d)
91

Descripción

Reference-only has shown be a very powerful mechanism for outpainting as well as image variation. We should investigate a bit how we can best support this in a modularized, library-friendly way in `diffusers`. Also I think we should try this out for SDXL.

Related links:
- https://github.com/Mikubill/sd-webui-controlnet/discussions/1280
- https://github.com/Mikubill/sd-webui-controlnet/discussions/1464
- https://github.com/Mikubill/sd-webui-controlnet/discussions/1236

and

https://github.com/huggingface/diffusers/blob/main/examples/community/stable_diffusion_controlnet_reference.py
https://github.com/huggingface/diffusers/blob/main/examples/community/stable_diffusion_reference.py

@DN6 maybe this could be a first fun project for you

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.