huggingface / huggingface/diffusers

A new pipeline for inpainting(object removal) is needed!!

Aperta
#4,836 8 commenti 1 reazione 0 assegnatari Vedi su GitHub
community-examples New pipeline/model
Lingua principale
Python
Stelle
34.5k
Fork
7.3k
Merge medio
3g 3h
PR unite (30g)
91

Descrizione

**Is your feature request related to a problem? Please describe.**
Thanks for your great work!!
Right now I'm using StableDiffusionInpaintPipeline with fixed prompt(such as "the empty background") to do object removal task, but one thing i've found is that **when the inpaint mask doesn't cover the shadow or hairline, the model will randomly generate objects else in the mask rather than generating pure background,** which is frustrating. I wonder if the inpaint pipeline is trained for removing object ? If not, when will the inpaint model trained for object removal be released(works like LDM inpainting or LaMa)? As this feature can be really useful in practice!

**Describe the solution you'd like**
Plz release the inpaint pipeline specialized for object removal!

**Describe alternatives you've considered**
Give some advice about getting rid of unwanted object generation

unwanted object generation:
![A57CD3D6-DA0C-4FA3-9A88-373C7E21AC9A](https://github.com/huggingface/diffusers/assets/52605055/7e5a4537-cf4a-4dbd-b4b6-ae9995ff64b7)
![F84FF064-F0D9-43DA-83A4-BF4FACB5E910](https://github.com/huggingface/diffusers/assets/52605055/66d54ad9-77a1-43ec-8c61-db7915292198)
![7CB3DC41-76FF-40CF-B32A-1D3D4A309D50](https://github.com/huggingface/diffusers/assets/52605055/669ac226-78bd-4c61-bfcc-b8271df64d53)

Guida per i contributori

Apri la guida per i contributori

Direzione di ricerca

Start with StableDiffusionInpaintPipeline and review the issue's mask and prompt behavior, then compare the requested object-removal use case with the referenced LDM inpainting and LaMa approaches. Done would require an agreed model or training scope and a documented pipeline or recommendation, but the issue names no files or tests.

Scritto dal modello di indicizzazione a partire dal testo della issue.

Valutazione

Stack tecnologico
python
Ambito
computer-vision, machine-learning
Tipo di issue
Funzionalità
Difficoltà
5/5
Tempo stimato
Più di una settimana
Stato di attività
Ferma
Chiarezza
Da chiarire
Idoneità per principianti
20/100

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.