lllyasviel / lllyasviel/stable-diffusion-webui-forge

[Bug]: NeverOOM sometimes crashes the generation

Open
#484 6 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
13k
Forks
1.7k
PR merge metrics
No merged PRs in 30d

Description

### Checklist

- [X] The issue exists after disabling all extensions
- [X] The issue exists on a clean installation of webui
- [ ] The issue is caused by an extension, but I believe it is caused by a bug in the webui
- [X] The issue exists in the current version of the webui
- [ ] The issue has not been reported before recently
- [X] The issue has been reported before but has not been fixed yet

### What happened?

NeverOOM options result in either
`RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu!`
or
`TypeError: 'NoneType' object is not iterable`

### Steps to reproduce the problem

1. Enable All/One of NeverOOM options (especially tiled vae)
2. Watch the generation crash
3. With disabled tiled vae try generating an XYZ grid with model changes

### What should have happened?

Generation shouldn't crash

### What browsers do you use to access the UI ?

Google Chrome, Microsoft Edge

### Sysinfo

[sysinfo-2024-03-04-12-41.json](https://github.com/lllyasviel/stable-diffusion-webui-forge/files/14481577/sysinfo-2024-03-04-12-41.json)

### Console logs

```Shell
https://paste.ee/p/DFdks
```

### Additional information

_No response_

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the crash with the NeverOOM options, especially tiled VAE, and then with an XYZ grid after disabling tiled VAE. Review the linked console log and sysinfo for the reported device-mismatch and NoneType errors; done means generation completes without either crash.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.