lllyasviel / lllyasviel/stable-diffusion-webui-forge

[Bug]: Soft Inpainting doesn't do anything: Automatic1111 Outperforms, Possible Forge Issue

Open
#490 10 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

bug
Dominant language
Python
Stars
13k
Forks
1.7k
PR merge metrics
No merged PRs in 30d

Description

### Checklist

- [X] The issue exists after disabling all extensions
- [X] The issue exists on a clean installation of webui
- [X] The issue is caused by an extension, but I believe it is caused by a bug in the webui
- [X] The issue exists in the current version of the webui
- [X] The issue has not been reported before recently
- [ ] The issue has been reported before but has not been fixed yet

### What happened?

I recently came to an understanding while following a tutorial on inpainting that featured the "Soft Inpainting" option. Despite adhering to the instructions and utilizing the "Soft Inpainting" checkbox within Forge, it didn't perform as expected—especially when I increased the mask blur, which what was demonstrated in the video using the latest Automatic1111 fork. The inpainting results from Forge tended to be more blurred overall. In contrast, I've found that Automatic1111 provides much better outcomes, although Forge operates significantly faster and without VRAM errors. I would be immensely appreciative if this issue could be addressed. I applied the same "Soft Inpainting" settings on both platforms.

![inpaint difference](https://github.com/lllyasviel/stable-diffusion-webui-forge/assets/102416555/dae90142-7359-4faf-98ac-88ec2dac6a0b)

### Steps to reproduce the problem

![Automatic1111](https://github.com/lllyasviel/stable-diffusion-webui-forge/assets/102416555/0598f846-99c3-4da4-87ba-ef733f303546)
![Forge](https://github.com/lllyasviel/stable-diffusion-webui-forge/assets/102416555/d60895ca-395c-4a3d-b36d-1cbbaf5f998f)
![inpaint difference](https://github.com/lllyasviel/stable-diffusion-webui-forge/assets/102416555/ba83a5b4-c8cf-420e-af87-089c8c68c1ad)

### What should have happened?

When enabling "Soft Inpainting" it should preserve the masked selection and inpainting.

### What browsers do you use to access the UI ?

Google Chrome

### Sysinfo

[sysinfo-2024-03-05-10-43.json](https://github.com/lllyasviel/stable-diffusion-webui-forge/files/14494031/sysinfo-2024-03-05-10-43.json)

### Console logs

```Shell
None
```

### Additional information

_No response_

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the report with the same Soft Inpainting and mask-blur settings in Forge and Automatic1111, using the attached screenshots and sysinfo as reference. Compare the resulting masked regions and identify the relevant inpainting path; the issue is done when Forge preserves the masked selection and produces comparable results.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.