Comfy-Org / Comfy-Org/ComfyUI

Add on hold for "loading checkpoint or unet or so on" only start when running their own function to save VRAM

Open
#5,337 0 comments 0 reactions 0 assignees View on GitHub
Feature
Dominant language
Python
Stars
133k
Forks
15.7k
Avg merge
1d 10h
Merged PRs (30d)
153

Description

### Feature Idea

I use LLM node to create prompt inside Comfyui, however when loading LLM checkpoint, ComfyUI also loading Flux checkpoint which increate VRAM alot when I only generate prompt then when ComfyUI begin generate image, ComfyUI does not unload Vram of LLM checkpoint.

### Existing Solutions

Make checkpoint loading node wait and begin loading only when receive some signal like prompt or logic value or some else. Release Vram of checkpoint whenever its finish generate image (for example: SAM model, after generate mask image unload VRAM, LLM or VLM node after creating prompt then unload model and cache and only load checkpoint into VRAM only when receive input either image or text)

### Other

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.