huggingface / huggingface/diffusers

A new pipeline for inpainting(object removal) is needed!!

Offen
#4,836 8 Kommentare 1 Reaktion 0 zugewiesene Personen Auf GitHub ansehen
community-examples New pipeline/model
Vorherrschende Sprache
Python
Sterne
34.5k
Forks
7.3k
Ø Merge
3 T. 3 Std.
Gemergte PRs (30 T.)
91

Beschreibung

**Is your feature request related to a problem? Please describe.**
Thanks for your great work!!
Right now I'm using StableDiffusionInpaintPipeline with fixed prompt(such as "the empty background") to do object removal task, but one thing i've found is that **when the inpaint mask doesn't cover the shadow or hairline, the model will randomly generate objects else in the mask rather than generating pure background,** which is frustrating. I wonder if the inpaint pipeline is trained for removing object ? If not, when will the inpaint model trained for object removal be released(works like LDM inpainting or LaMa)? As this feature can be really useful in practice!

**Describe the solution you'd like**
Plz release the inpaint pipeline specialized for object removal!

**Describe alternatives you've considered**
Give some advice about getting rid of unwanted object generation

unwanted object generation:
![A57CD3D6-DA0C-4FA3-9A88-373C7E21AC9A](https://github.com/huggingface/diffusers/assets/52605055/7e5a4537-cf4a-4dbd-b4b6-ae9995ff64b7)
![F84FF064-F0D9-43DA-83A4-BF4FACB5E910](https://github.com/huggingface/diffusers/assets/52605055/66d54ad9-77a1-43ec-8c61-db7915292198)
![7CB3DC41-76FF-40CF-B32A-1D3D4A309D50](https://github.com/huggingface/diffusers/assets/52605055/669ac226-78bd-4c61-bfcc-b8271df64d53)

Beitragsleitfaden

Beitragsleitfaden öffnen

Rechercherichtung

Start with StableDiffusionInpaintPipeline and review the issue's mask and prompt behavior, then compare the requested object-removal use case with the referenced LDM inpainting and LaMa approaches. Done would require an agreed model or training scope and a documented pipeline or recommendation, but the issue names no files or tests.

Vom Indexierungsmodell aus dem Issue-Text verfasst.

Bewertung

Tech-Stack
python
Bereich
computer-vision, machine-learning
Issue-Typ
Feature
Schwierigkeit
5/5
Geschätzter Aufwand
Über eine Woche
Aktivitätsstatus
Veraltet
Klarheit
Muss geklärt werden
Anfängerfreundlichkeit
20/100

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.