lllyasviel / lllyasviel/stable-diffusion-webui-forge
torch.OutOfMemoryError: Allocation on device
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 13k
- Forks
- 1.7k
- PR merge metrics
- No merged PRs in 30d
Description
I'm desperate:
Crashes every second generation on a 4090 with 24G , sometimes even the pycache files are corrupted and have all to be deleted.
Sometimes even Segfaults occur.
Please return back to a state where a "creating", initiated by a click on the button, starts a creation run with just cleared (cuda) GPU Memory, respecting the GUI entry for "GPU Weights (MB)".
After that generation all used memory, CPU and GPU will be cleared again !!!
This enables us users that also use for example ollama to use it to enhance prompts etc. in the meanwhile.
Imho this is rule nr 1 for AI programs to be run on consumers boxes:
Always clear the memory you used for one task after that completely! to let the user also use other local AI Programs or Models that may also need to use many GPU resources.
Please.... I simply do not want to use comfy, I don't like it's interface
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No files, tests, or entry points are named. Start by locating the generation and GPU-memory management paths, then determine how the GUI's "GPU Weights (MB)" setting is applied. Done means a button-triggered run avoids the reported allocation and crashes, and releases its CPU and GPU memory afterward.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning, performance
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 15/100