Comfy-Org / Comfy-Org/ComfyUI

Flux Model GPU Allocation Problem in ComfyUI

Open
#6,497 1 comment 0 reactions 0 assignees View on GitHub
User Support
Dominant language
Python
Stars
133k
Forks
15.7k
Avg merge
1d 10h
Merged PRs (30d)
153

Description

### Your question

I want to use flux , but i have only 6gb vram in my RTX 4050 gpu , so i tried "flux1-dev-bnb-nf4-v2.safetensors" with "ComfyUl" but now I am getting an error saying " SamplerCustomAdvanced
All input tensors need to be on the same GPU, but found some tensors to not be on a GPU:
[(torch.Size([1, 98304]), device(type='cpu')), (torch.Size([3072]), device(type='cpu')), (torch.Size([3072, 64]), device(type='cpu'))] "
and i reffered "https://youtu.be/tOlCoJlM4os?si=qy1XB07aEsIsSBdY" this perticular vedio to setup every thing and I am using ComfyUl though "Krita AI"

### Logs

```powershell

```

### Other

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.