Comfy-Org / Comfy-Org/ComfyUI

Allocation on device

Open
#6,693 6 comments 0 reactions 0 assignees View on GitHub
Potential Bug
Dominant language
Python
Stars
133k
Forks
15.7k
Avg merge
1d 6h
Merged PRs (30d)
155

Description

### Expected Behavior

After last update I cannot run my workflows. I got Allocation on device error.

**ComfyUI Version:** 0.3.13

### Actual Behavior

CAn run my pipeline, I got error.

### Steps to Reproduce

Run the pipeline.

### Debug Logs

```powershell
Manager

1

torch.OutOfMemoryError 11 DualCLIPLoader
The reference sampling implementation auto adjusts the shift value based on the resolution, if you don't want this you can just bypass (CTRL-B) this ModelSamplingFlux node.

text
DualCLIPLoader
Allocation on device

# ComfyUI Error Report
## Error Details
- **Node ID:** 11
- **Node Type:** DualCLIPLoader
- **Exception Type:** torch.OutOfMemoryError
- **Exception Message:** Allocation on device
## Stack Trace

File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 327, in execute
output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 202, in get_output_data
return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 174, in _map_node_over_list
process_inputs(input_dict, i)

File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 163, in process_inputs
results.append(getattr(obj, func)(**inputs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\nodes.py", line 988, in load_clip
clip = comfy.sd.load_clip(ckpt_paths=[clip_path1, clip_path2], embedding_directory=folder_paths.get_folder_paths("embeddings"), clip_type=clip_type, model_options=model_options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\sd.py", line 666, in load_clip
return load_text_encoder_state_dicts(clip_data, embedding_directory=embedding_directory, clip_type=clip_type, model_options=model_options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\sd.py", line 806, in load_text_encoder_state_dicts
clip = CLIP(clip_target, embedding_directory=embedding_directory, parameters=parameters, tokenizer_data=tokenizer_data, model_options=model_options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\sd.py", line 98, in __init__
self.cond_stage_model = clip(**(params))
^^^^^^^^^^^^^^^^

File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\flux.py", line 71, in __init__
super().__init__(dtype_t5=dtype_t5, device=device, dtype=dtype, model_options=model_options)

File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\flux.py", line 40, in __init__
self.t5xxl = comfy.text_encoders.sd3_clip.T5XXLModel(device=device, dtype=dtype_t5, model_options=model_options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\sd3_clip.py", line 18, in __init__
super().__init__(device=device, layer=layer, layer_idx=layer_idx, textmodel_json_config=textmodel_json_config, dtype=dtype, special_tokens={"end": 1, "pad": 0}, model_class=comfy.text_encoders.t5.T5, enable_attention_masks=attention_mask, return_attention_masks=attention_mask, model_options=model_options)

File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\sd1_clip.py", line 114, in __init__
self.transformer = model_class(config, dtype, device, self.operations)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\t5.py", line 232, in __init__
self.encoder = T5Stack(self.num_layers, model_dim, inner_dim, config_dict["d_ff"], config_dict["dense_act_fn"], config_dict["is_gated_act"], config_dict["num_heads"], config_dict["model_type"] != "umt5", dtype, device, operations)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\t5.py", line 197, in __init__
[T5Block(model_dim, inner_dim, ff_dim, ff_activation, gated_act, num_heads, relative_attention_bias=((not relative_attention) or (i == 0)), dtype=dtype, device=device, operations=operations) for i in range(num_layers)]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\t5.py", line 185, in __init__
self.layer.append(T5LayerFF(model_dim, ff_dim, ff_activation, gated_act, dtype, device, operations))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\t5.py", line 57, in __init__
self.DenseReluDense = T5DenseGatedActDense(model_dim, ff_dim, ff_activation, dtype, device, operations)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\t5.py", line 40, in __init__
self.wi_1 = operations.Linear(model_dim, ff_dim, bias=False, dtype=dtype, device=device)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "C:\pinokio\api\Comfyui\.venv\Lib\site-packages\torch\nn\modules\linear.py", line 106, in __init__
torch.empty((out_features, in_features), **factory_kwargs)

## System Information
- **ComfyUI Version:** 0.3.13
- **Arguments:** C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\main.py --user-directory C:\pinokio\api\Comfyui\user --input-directory C:\pinokio\api\Comfyui\input --output-directory C:\pinokio\api\Comfyui\output --front-end-root C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\web_custom_versions\desktop_app --extra-model-paths-config C:\Users\Łukasz\AppData\Roaming\ComfyUI\extra_models_config.yaml --port 8000 --listen 127.0.0.1
- **OS:** nt
- **Python Version:** 3.12.8 (tags/v3.12.8:2dc476b, Dec 3 2024, 19:30:04) [MSC v.1942 64 bit (AMD64)]
- **Embedded Python:** false
- **PyTorch Version:** 2.5.1+cu121
## Devices

- **Name:** cuda:0 NVIDIA GeForce RTX 4080 SUPER : cudaMallocAsync
- **Type:** cuda
- **VRAM Total:** 17170956288
- **VRAM Free:** 3064089970
- **Torch VRAM Total:** 12415139840
- **Torch VRAM Free:** 48278912

## Logs

2025-02-04T02:23:39.138371 - Adding extra search path checkpoints C:\pinokio\api\Comfyui\models\checkpoints\
2025-02-04T02:23:39.138371 - Adding extra search path classifiers C:\pinokio\api\Comfyui\models\classifiers\
2025-02-04T02:23:39.138371 - Adding extra search path clip C:\pinokio\api\Comfyui\models\clip\
2025-02-04T02:23:39.138371 - Adding extra search path clip_vision C:\pinokio\api\Comfyui\models\clip_vision\
2025-02-04T02:23:39.138371 - Adding extra search path configs C:\pinokio\api\Comfyui\models\configs\
2025-02-04T02:23:39.138371 - Adding extra search path controlnet C:\pinokio\api\Comfyui\models\controlnet\
2025-02-04T02:23:39.138371 - Adding extra search path diffusers C:\pinokio\api\Comfyui\models\diffusers\
2025-02-04T02:23:39.138371 - Adding extra search path diffusion_models C:\pinokio\api\Comfyui\models\diffusion_models\
2025-02-04T02:23:39.138371 - Adding extra search path embeddings C:\pinokio\api\Comfyui\models\embeddings\
2025-02-04T02:23:39.138371 - Adding extra search path gligen C:\pinokio\api\Comfyui\models\gligen\
2025-02-04T02:23:39.138371 - Adding extra search path hypernetworks C:\pinokio\api\Comfyui\models\hypernetworks\
2025-02-04T02:23:39.138371 - Adding extra search path loras C:\pinokio\api\Comfyui\models\loras\
2025-02-04T02:23:39.138371 - Adding extra search path photomaker C:\pinokio\api\Comfyui\models\photomaker\
2025-02-04T02:23:39.138371 - Adding extra search path style_models C:\pinokio\api\Comfyui\models\style_models\
2025-02-04T02:23:39.138371 - Adding extra search path unet C:\pinokio\api\Comfyui\models\unet\
2025-02-04T02:23:39.138371 - Adding extra search path upscale_models C:\pinokio\api\Comfyui\models\upscale_models\
2025-02-04T02:23:39.138371 - Adding extra search path vae C:\pinokio\api\Comfyui\models\vae\
2025-02-04T02:23:39.138371 - Adding extra search path vae_approx C:\pinokio\api\Comfyui\models\vae_approx\
2025-02-04T02:23:39.138371 - Adding extra search path animatediff_models C:\pinokio\api\Comfyui\models\animatediff_models\
2025-02-04T02:23:39.138371 - Adding extra search path animatediff_motion_lora C:\pinokio\api\Comfyui\models\animatediff_motion_lora\
2025-02-04T02:23:39.138371 - Adding extra search path animatediff_video_formats C:\pinokio\api\Comfyui\models\animatediff_video_formats\
2025-02-04T02:23:39.138371 - Adding extra search path ipadapter C:\pinokio\api\Comfyui\models\ipadapter\
2025-02-04T02:23:39.138371 - Adding extra search path liveportrait C:\pinokio\api\Comfyui\models\liveportrait\
2025-02-04T02:23:39.138371 - Adding extra search path insightface C:\pinokio\api\Comfyui\models\insightface\
2025-02-04T02:23:39.138371 - Adding extra search path layerstyle C:\pinokio\api\Comfyui\models\layerstyle\
2025-02-04T02:23:39.138371 - Adding extra search path LLM C:\pinokio\api\Comfyui\models\LLM\
2025-02-04T02:23:39.138371 - Adding extra search path Joy_caption C:\pinokio\api\Comfyui\models\Joy_caption\
2025-02-04T02:23:39.138371 - Adding extra search path sams C:\pinokio\api\Comfyui\models\sams\
2025-02-04T02:23:39.138371 - Adding extra search path blip C:\pinokio\api\Comfyui\models\blip\
2025-02-04T02:23:39.138371 - Adding extra search path CogVideo C:\pinokio\api\Comfyui\models\CogVideo\
2025-02-04T02:23:39.138371 - Adding extra search path xlabs C:\pinokio\api\Comfyui\models\xlabs\
2025-02-04T02:23:39.138371 - Adding extra search path instantid C:\pinokio\api\Comfyui\models\instantid\
2025-02-04T02:23:39.138371 - Adding extra search path custom_nodes C:\pinokio\api\Comfyui\custom_nodes/
2025-02-04T02:23:39.138371 - Adding extra search path download_model_base C:\pinokio\api\Comfyui\models
2025-02-04T02:23:39.138371 - Setting output directory to: C:\pinokio\api\Comfyui\output
2025-02-04T02:23:39.138371 - Setting input directory to: C:\pinokio\api\Comfyui\input
2025-02-04T02:23:39.138371 - Setting user directory to: C:\pinokio\api\Comfyui\user
2025-02-04T02:23:39.149057 - [START] Security scan2025-02-04T02:23:39.149057 -
2025-02-04T02:23:39.922718 - [DONE] Security scan2025-02-04T02:23:39.922718 -
2025-02-04T02:23:40.022829 - ## ComfyUI-Manager: installing dependencies done.2025-02-04T02:23:40.022829 -
2025-02-04T02:23:40.022829 - ** ComfyUI startup time:2025-02-04T02:23:40.022829 - 2025-02-04T02:23:40.022829 - 2025-02-04 02:23:40.0228292025-02-04T02:23:40.022829 -
2025-02-04T02:23:40.044257 - ** Platform:2025-02-04T02:23:40.044257 - 2025-02-04T02:23:40.044257 - Windows2025-02-04T02:23:40.044257 -
2025-02-04T02:23:40.044257 - ** Python version:2025-02-04T02:23:40.044257 - 2025-02-04T02:23:40.044257 - 3.12.8 (tags/v3.12.8:2dc476b, Dec 3 2024, 19:30:04) [MSC v.1942 64 bit (AMD64)]2025-02-04T02:23:40.044257 -
2025-02-04T02:23:40.044257 - ** Python executable:2025-02-04T02:23:40.044257 - 2025-02-04T02:23:40.044257 - C:\pinokio\api\Comfyui\.venv\Scripts\python.exe2025-02-04T02:23:40.044257 -
2025-02-04T02:23:40.044257 - ** ComfyUI Path:2025-02-04T02:23:40.044257 - 2025-02-04T02:23:40.044257 - C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI2025-02-04T02:23:40.044257 -
2025-02-04T02:23:40.044257 - ** Log path:2025-02-04T02:23:40.044257 - 2025-02-04T02:23:40.044257 - C:\pinokio\api\Comfyui\comfyui.log2025-02-04T02:23:40.044257 -
2025-02-04T02:23:40.976823 -
Prestartup times for custom nodes:
2025-02-04T02:23:40.976823 - 1.8 seconds: C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\custom_nodes\ComfyUI-Manager
2025-02-04T02:23:40.976823 -
2025-02-04T02:23:42.378469 - Checkpoint files will always be loaded safely.
2025-02-04T02:23:42.457441 - Total VRAM 16376 MB, total RAM 32607 MB
2025-02-04T02:23:42.457441 - pytorch version: 2.5.1+cu121
2025-02-04T02:23:42.458434 - Set vram state to: NORMAL_VRAM
2025-02-04T02:23:42.458434 - Device: cuda:0 NVIDIA GeForce RTX 4080 SUPER : cudaMallocAsync
2025-02-04T02:23:43.452610 - Using pytorch attention
2025-02-04T02:23:44.606752 - ComfyUI version: 0.3.13
2025-02-04T02:23:44.638027 - [Prompt Server] web root: C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\web_custom_versions\desktop_app
2025-02-04T02:23:45.415572 - [ComfyUI-Easy-Use] server: v1.2.7 Loaded2025-02-04T02:23:45.415572 -
2025-02-04T02:23:45.415572 - [ComfyUI-Easy-Use] web root: C:\pinokio\api\Comfyui\custom_nodes\ComfyUI-Easy-Use\web_version/v2 Loaded2025-02-04T02:23:45.415572 -
2025-02-04T02:23:45.459578 - MultiGPU: Checking for module at C:\pinokio\api\Comfyui\custom_nodes/ComfyUI-LTXVideo
2025-02-04T02:23:45.459578 - MultiGPU: Found ComfyUI-LTXVideo, creating compatible MultiGPU nodes
2025-02-04T02:23:45.459578 - MultiGPU: Registered LTXVLoaderMultiGPU
2025-02-04T02:23:45.459578 - MultiGPU: Checking for module at C:\pinokio\api\Comfyui\custom_nodes/ComfyUI-Florence2
2025-02-04T02:23:45.460578 - MultiGPU: Module ComfyUI-Florence2 not found - skipping
2025-02-04T02:23:45.460578 - MultiGPU: Checking for module at C:\pinokio\api\Comfyui\custom_nodes/comfyui-florence2
2025-02-04T02:23:45.460578 - MultiGPU: Module comfyui-florence2 not found - skipping
2025-02-04T02:23:45.460578 - MultiGPU: Checking for module at C:\pinokio\api\Comfyui\custom_nodes/ComfyUI_bitsandbytes_NF4
2025-02-04T02:23:45.460578 - MultiGPU: Module ComfyUI_bitsandbytes_NF4 not found - skipping
2025-02-04T02:23:45.460578 - MultiGPU: Checking for module at C:\pinokio\api\Comfyui\custom_nodes/comfyui_bitsandbytes_nf4
2025-02-04T02:23:45.460578 - MultiGPU: Module comfyui_bitsandbytes_nf4 not found - skipping
2025-02-04T02:23:45.460578 - MultiGPU: Checking for module at C:\pinokio\api\Comfyui\custom_nodes/x-flux-comfyui
2025-02-04T02:23:45.460578 - MultiGPU: Module x-flux-comfyui not found - skipping
2025-02-04T02:23:45.460578 - MultiGPU: Checking for module at C:\pinokio\api\Comfyui\custom_nodes/x-flux-comfyui
2025-02-04T02:23:45.460578 - MultiGPU: Module x-flux-comfyui not found - skipping
2025-02-04T02:23:45.460578 - MultiGPU: Checking for module at C:\pinokio\api\Comfyui\custom_nodes/ComfyUI-MMAudio
2025-02-04T02:23:45.460578 - MultiGPU: Module ComfyUI-MMAudio not found - skipping
2025-02-04T02:23:45.460578 - MultiGPU: Checking for module at C:\pinokio\api\Comfyui\custom_nodes/comfyui-mmaudio
2025-02-04T02:23:45.460578 - MultiGPU: Module comfyui-mmaudio not found - skipping
2025-02-04T02:23:45.460578 - MultiGPU: Checking for module at C:\pinokio\api\Comfyui\custom_nodes/ComfyUI-GGUF
2025-02-04T02:23:45.460578 - MultiGPU: Found ComfyUI-GGUF, creating compatible MultiGPU nodes
2025-02-04T02:23:45.460578 - MultiGPU: Registered UnetLoaderGGUFMultiGPU
2025-02-04T02:23:45.460578 - MultiGPU: Registered UnetLoaderGGUFDisTorchMultiGPU
2025-02-04T02:23:45.460578 - MultiGPU: Registered UnetLoaderGGUFAdvancedMultiGPU
2025-02-04T02:23:45.460578 - MultiGPU: Registered UnetLoaderGGUFAdvancedDisTorchMultiGPU
2025-02-04T02:23:45.460578 - MultiGPU: Registered CLIPLoaderGGUFMultiGPU
2025-02-04T02:23:45.460578 - MultiGPU: Registered CLIPLoaderGGUFDisTorchMultiGPU
2025-02-04T02:23:45.460578 - MultiGPU: Registered DualCLIPLoaderGGUFMultiGPU
2025-02-04T02:23:45.460578 - MultiGPU: Registered DualCLIPLoaderGGUFDisTorchMultiGPU
2025-02-04T02:23:45.460578 - MultiGPU: Registered TripleCLIPLoaderGGUFMultiGPU
2025-02-04T02:23:45.460578 - MultiGPU: Registered TripleCLIPLoaderGGUFDisTorchMultiGPU
2025-02-04T02:23:45.460578 - MultiGPU: Checking for module at C:\pinokio\api\Comfyui\custom_nodes/PuLID_ComfyUI
2025-02-04T02:23:45.460578 - MultiGPU: Module PuLID_ComfyUI not found - skipping
2025-02-04T02:23:45.460578 - MultiGPU: Checking for module at C:\pinokio\api\Comfyui\custom_nodes/pulid_comfyui
2025-02-04T02:23:45.460578 - MultiGPU: Module pulid_comfyui not found - skipping
2025-02-04T02:23:45.460578 - MultiGPU: Checking for module at C:\pinokio\api\Comfyui\custom_nodes/ComfyUI-HunyuanVideoWrapper
2025-02-04T02:23:45.460578 - MultiGPU: Module ComfyUI-HunyuanVideoWrapper not found - skipping
2025-02-04T02:23:45.460578 - MultiGPU: Checking for module at C:\pinokio\api\Comfyui\custom_nodes/comfyui-hunyuanvideowrapper
2025-02-04T02:23:45.461578 - MultiGPU: Module comfyui-hunyuanvideowrapper not found - skipping
2025-02-04T02:23:45.461578 - MultiGPU: Registration complete. Final mappings: DeviceSelectorMultiGPU, HunyuanVideoEmbeddingsAdapter, UNETLoaderMultiGPU, VAELoaderMultiGPU, CLIPLoaderMultiGPU, DualCLIPLoaderMultiGPU, TripleCLIPLoaderMultiGPU, CheckpointLoaderSimpleMultiGPU, ControlNetLoaderMultiGPU, LTXVLoaderMultiGPU, UnetLoaderGGUFMultiGPU, UnetLoaderGGUFDisTorchMultiGPU, UnetLoaderGGUFAdvancedMultiGPU, UnetLoaderGGUFAdvancedDisTorchMultiGPU, CLIPLoaderGGUFMultiGPU, CLIPLoaderGGUFDisTorchMultiGPU, DualCLIPLoaderGGUFMultiGPU, DualCLIPLoaderGGUFDisTorchMultiGPU, TripleCLIPLoaderGGUFMultiGPU, TripleCLIPLoaderGGUFDisTorchMultiGPU
2025-02-04T02:23:45.492733 - [comfyui_controlnet_aux] | INFO -> Using ckpts path: C:\pinokio\api\Comfyui\custom_nodes\comfyui_controlnet_aux\ckpts
2025-02-04T02:23:45.492733 - [comfyui_controlnet_aux] | INFO -> Using symlinks: False
2025-02-04T02:23:45.492733 - [comfyui_controlnet_aux] | INFO -> Using ort providers: ['CUDAExecutionProvider', 'DirectMLExecutionProvider', 'OpenVINOExecutionProvider', 'ROCMExecutionProvider', 'CPUExecutionProvider', 'CoreMLExecutionProvider']
2025-02-04T02:23:45.700918 - C:\pinokio\api\Comfyui\custom_nodes/comfyui_controlnet_aux\node_wrappers\dwpose.py:26: UserWarning: DWPose: Onnxruntime not found or doesn't come with acceleration providers, switch to OpenCV with CPU device. DWPose might run very slowly
warnings.warn("DWPose: Onnxruntime not found or doesn't come with acceleration providers, switch to OpenCV with CPU device. DWPose might run very slowly")
2025-02-04T02:23:45.758753 -
2025-02-04T02:23:45.758753 - [rgthree-comfy] Loaded 42 epic nodes. 🎉2025-02-04T02:23:45.758753 -
2025-02-04T02:23:45.758753 -
2025-02-04T02:23:46.364191 - WAS Node Suite: OpenCV Python FFMPEG support is enabled2025-02-04T02:23:46.364191 -
2025-02-04T02:23:46.364191 - WAS Node Suite Warning: `ffmpeg_bin_path` is not set in `C:\pinokio\api\Comfyui\custom_nodes\was-node-suite-comfyui\was_suite_config.json` config file. Will attempt to use system ffmpeg binaries if available.2025-02-04T02:23:46.364191 -
2025-02-04T02:23:46.838577 - WAS Node Suite: Finished. Loaded 220 nodes successfully.2025-02-04T02:23:46.838577 -
2025-02-04T02:23:46.838577 -
"Art enables us to find ourselves and lose ourselves at the same time." - Thomas Merton
2025-02-04T02:23:46.838577 -
2025-02-04T02:23:46.847537 - ### Loading: ComfyUI-Manager (V2.55.3)2025-02-04T02:23:46.847537 -
2025-02-04T02:23:46.848536 - ### ComfyUI Revision: UNKNOWN (The currently installed ComfyUI is not a Git repository)2025-02-04T02:23:46.849536 -
2025-02-04T02:23:46.852549 -
Import times for custom nodes:
2025-02-04T02:23:46.852549 - 0.0 seconds: C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\custom_nodes\websocket_image_save.py
2025-02-04T02:23:46.852549 - 0.0 seconds: C:\pinokio\api\Comfyui\custom_nodes/ComfyUI-MultiGPU
2025-02-04T02:23:46.852549 - 0.0 seconds: C:\pinokio\api\Comfyui\custom_nodes/ComfyUI-GGUF
2025-02-04T02:23:46.852549 - 0.0 seconds: C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\custom_nodes\ComfyUI-Manager
2025-02-04T02:23:46.852549 - 0.0 seconds: C:\pinokio\api\Comfyui\custom_nodes/rgthree-comfy
2025-02-04T02:23:46.852549 - 0.0 seconds: C:\pinokio\api\Comfyui\custom_nodes/ComfyUI-VideoHelperSuite
2025-02-04T02:23:46.852549 - 0.0 seconds: C:\pinokio\api\Comfyui\custom_nodes/ComfyUI-LTXVideo
2025-02-04T02:23:46.852549 - 0.2 seconds: C:\pinokio\api\Comfyui\custom_nodes/comfyui_controlnet_aux
2025-02-04T02:23:46.852549 - 0.3 seconds: C:\pinokio\api\Comfyui\custom_nodes/ComfyUI-Easy-Use
2025-02-04T02:23:46.852549 - 1.1 seconds: C:\pinokio\api\Comfyui\custom_nodes/was-node-suite-comfyui
2025-02-04T02:23:46.852549 -
2025-02-04T02:23:46.922922 - Starting server

2025-02-04T02:23:46.922922 - To see the GUI go to: http://127.0.0.1:8000
2025-02-04T02:23:46.964795 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/alter-list.json2025-02-04T02:23:46.964795 -
2025-02-04T02:23:46.974801 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/model-list.json2025-02-04T02:23:46.974801 -
2025-02-04T02:23:46.992832 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/github-stats.json2025-02-04T02:23:46.992832 -
2025-02-04T02:23:47.025908 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/extension-node-map.json2025-02-04T02:23:47.025908 -
2025-02-04T02:23:47.041856 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json2025-02-04T02:23:47.041856 -
2025-02-04T02:23:47.662417 - FETCH DATA from: C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\custom_nodes\ComfyUI-Manager\extension-node-map.json2025-02-04T02:23:47.662417 - 2025-02-04T02:23:47.669815 - [DONE]2025-02-04T02:23:47.669815 -
2025-02-04T02:24:23.994571 - got prompt
2025-02-04T02:24:23.994571 - Using pytorch attention in VAE
2025-02-04T02:24:23.994571 - Using pytorch attention in VAE
2025-02-04T02:24:24.076314 - VAE load device: cuda:0, offload device: cpu, dtype: torch.bfloat16
2025-02-04T02:24:24.125437 - model weight dtype torch.float8_e4m3fn, manual cast: torch.bfloat16
2025-02-04T02:24:24.125437 - model_type FLUX
2025-02-04T02:24:37.675294 - !!! Exception during processing !!! Allocation on device
2025-02-04T02:24:37.707647 - Traceback (most recent call last):
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 327, in execute
output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 202, in get_output_data
return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 174, in _map_node_over_list
process_inputs(input_dict, i)
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 163, in process_inputs
results.append(getattr(obj, func)(**inputs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\nodes.py", line 988, in load_clip
clip = comfy.sd.load_clip(ckpt_paths=[clip_path1, clip_path2], embedding_directory=folder_paths.get_folder_paths("embeddings"), clip_type=clip_type, model_options=model_options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\sd.py", line 666, in load_clip
return load_text_encoder_state_dicts(clip_data, embedding_directory=embedding_directory, clip_type=clip_type, model_options=model_options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\sd.py", line 806, in load_text_encoder_state_dicts
clip = CLIP(clip_target, embedding_directory=embedding_directory, parameters=parameters, tokenizer_data=tokenizer_data, model_options=model_options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\sd.py", line 98, in __init__
self.cond_stage_model = clip(**(params))
^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\flux.py", line 71, in __init__
super().__init__(dtype_t5=dtype_t5, device=device, dtype=dtype, model_options=model_options)
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\flux.py", line 40, in __init__
self.t5xxl = comfy.text_encoders.sd3_clip.T5XXLModel(device=device, dtype=dtype_t5, model_options=model_options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\sd3_clip.py", line 18, in __init__
super().__init__(device=device, layer=layer, layer_idx=layer_idx, textmodel_json_config=textmodel_json_config, dtype=dtype, special_tokens={"end": 1, "pad": 0}, model_class=comfy.text_encoders.t5.T5, enable_attention_masks=attention_mask, return_attention_masks=attention_mask, model_options=model_options)
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\sd1_clip.py", line 114, in __init__
self.transformer = model_class(config, dtype, device, self.operations)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\t5.py", line 232, in __init__
self.encoder = T5Stack(self.num_layers, model_dim, inner_dim, config_dict["d_ff"], config_dict["dense_act_fn"], config_dict["is_gated_act"], config_dict["num_heads"], config_dict["model_type"] != "umt5", dtype, device, operations)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\t5.py", line 197, in __init__
[T5Block(model_dim, inner_dim, ff_dim, ff_activation, gated_act, num_heads, relative_attention_bias=((not relative_attention) or (i == 0)), dtype=dtype, device=device, operations=operations) for i in range(num_layers)]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\t5.py", line 185, in __init__
self.layer.append(T5LayerFF(model_dim, ff_dim, ff_activation, gated_act, dtype, device, operations))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\t5.py", line 57, in __init__
self.DenseReluDense = T5DenseGatedActDense(model_dim, ff_dim, ff_activation, dtype, device, operations)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\t5.py", line 40, in __init__
self.wi_1 = operations.Linear(model_dim, ff_dim, bias=False, dtype=dtype, device=device)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\pinokio\api\Comfyui\.venv\Lib\site-packages\torch\nn\modules\linear.py", line 106, in __init__
torch.empty((out_features, in_features), **factory_kwargs)
torch.OutOfMemoryError: Allocation on device

2025-02-04T02:24:37.708211 - Got an OOM, unloading all loaded models.
2025-02-04T02:24:37.725500 - Prompt executed in 13.73 seconds
2025-02-04T02:26:28.026931 - got prompt
2025-02-04T02:26:28.772531 - !!! Exception during processing !!! Allocation on device
2025-02-04T02:26:28.784364 - Traceback (most recent call last):
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 327, in execute
output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 202, in get_output_data
return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 174, in _map_node_over_list
process_inputs(input_dict, i)
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 163, in process_inputs
results.append(getattr(obj, func)(**inputs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\nodes.py", line 988, in load_clip
clip = comfy.sd.load_clip(ckpt_paths=[clip_path1, clip_path2], embedding_directory=folder_paths.get_folder_paths("embeddings"), clip_type=clip_type, model_options=model_options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\sd.py", line 666, in load_clip
return load_text_encoder_state_dicts(clip_data, embedding_directory=embedding_directory, clip_type=clip_type, model_options=model_options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\sd.py", line 806, in load_text_encoder_state_dicts
clip = CLIP(clip_target, embedding_directory=embedding_directory, parameters=parameters, tokenizer_data=tokenizer_data, model_options=model_options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\sd.py", line 98, in __init__
self.cond_stage_model = clip(**(params))
^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\flux.py", line 71, in __init__
super().__init__(dtype_t5=dtype_t5, device=device, dtype=dtype, model_options=model_options)
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\flux.py", line 40, in __init__
self.t5xxl = comfy.text_encoders.sd3_clip.T5XXLModel(device=device, dtype=dtype_t5, model_options=model_options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\sd3_clip.py", line 18, in __init__
super().__init__(device=device, layer=layer, layer_idx=layer_idx, textmodel_json_config=textmodel_json_config, dtype=dtype, special_tokens={"end": 1, "pad": 0}, model_class=comfy.text_encoders.t5.T5, enable_attention_masks=attention_mask, return_attention_masks=attention_mask, model_options=model_options)
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\sd1_clip.py", line 114, in __init__
self.transformer = model_class(config, dtype, device, self.operations)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\t5.py", line 232, in __init__
self.encoder = T5Stack(self.num_layers, model_dim, inner_dim, config_dict["d_ff"], config_dict["dense_act_fn"], config_dict["is_gated_act"], config_dict["num_heads"], config_dict["model_type"] != "umt5", dtype, device, operations)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\t5.py", line 197, in __init__
[T5Block(model_dim, inner_dim, ff_dim, ff_activation, gated_act, num_heads, relative_attention_bias=((not relative_attention) or (i == 0)), dtype=dtype, device=device, operations=operations) for i in range(num_layers)]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\t5.py", line 185, in __init__
self.layer.append(T5LayerFF(model_dim, ff_dim, ff_activation, gated_act, dtype, device, operations))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\t5.py", line 57, in __init__
self.DenseReluDense = T5DenseGatedActDense(model_dim, ff_dim, ff_activation, dtype, device, operations)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\t5.py", line 40, in __init__
self.wi_1 = operations.Linear(model_dim, ff_dim, bias=False, dtype=dtype, device=device)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\pinokio\api\Comfyui\.venv\Lib\site-packages\torch\nn\modules\linear.py", line 106, in __init__
torch.empty((out_features, in_features), **factory_kwargs)
torch.OutOfMemoryError: Allocation on device

2025-02-04T02:26:28.786368 - Got an OOM, unloading all loaded models.
2025-02-04T02:26:28.802955 - Prompt executed in 0.78 seconds
2025-02-04T02:28:17.916508 - got prompt
2025-02-04T02:28:18.439186 - !!! Exception during processing !!! Allocation on device
2025-02-04T02:28:18.439186 - Traceback (most recent call last):
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 327, in execute
output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 202, in get_output_data
return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 174, in _map_node_over_list
process_inputs(input_dict, i)
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\execution.py", line 163, in process_inputs
results.append(getattr(obj, func)(**inputs))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\nodes.py", line 988, in load_clip
clip = comfy.sd.load_clip(ckpt_paths=[clip_path1, clip_path2], embedding_directory=folder_paths.get_folder_paths("embeddings"), clip_type=clip_type, model_options=model_options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\sd.py", line 666, in load_clip
return load_text_encoder_state_dicts(clip_data, embedding_directory=embedding_directory, clip_type=clip_type, model_options=model_options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\sd.py", line 806, in load_text_encoder_state_dicts
clip = CLIP(clip_target, embedding_directory=embedding_directory, parameters=parameters, tokenizer_data=tokenizer_data, model_options=model_options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\sd.py", line 98, in __init__
self.cond_stage_model = clip(**(params))
^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\flux.py", line 71, in __init__
super().__init__(dtype_t5=dtype_t5, device=device, dtype=dtype, model_options=model_options)
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\flux.py", line 40, in __init__
self.t5xxl = comfy.text_encoders.sd3_clip.T5XXLModel(device=device, dtype=dtype_t5, model_options=model_options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\sd3_clip.py", line 18, in __init__
super().__init__(device=device, layer=layer, layer_idx=layer_idx, textmodel_json_config=textmodel_json_config, dtype=dtype, special_tokens={"end": 1, "pad": 0}, model_class=comfy.text_encoders.t5.T5, enable_attention_masks=attention_mask, return_attention_masks=attention_mask, model_options=model_options)
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\sd1_clip.py", line 114, in __init__
self.transformer = model_class(config, dtype, device, self.operations)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\t5.py", line 232, in __init__
self.encoder = T5Stack(self.num_layers, model_dim, inner_dim, config_dict["d_ff"], config_dict["dense_act_fn"], config_dict["is_gated_act"], config_dict["num_heads"], config_dict["model_type"] != "umt5", dtype, device, operations)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\t5.py", line 197, in __init__
[T5Block(model_dim, inner_dim, ff_dim, ff_activation, gated_act, num_heads, relative_attention_bias=((not relative_attention) or (i == 0)), dtype=dtype, device=device, operations=operations) for i in range(num_layers)]
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\t5.py", line 185, in __init__
self.layer.append(T5LayerFF(model_dim, ff_dim, ff_activation, gated_act, dtype, device, operations))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\t5.py", line 57, in __init__
self.DenseReluDense = T5DenseGatedActDense(model_dim, ff_dim, ff_activation, dtype, device, operations)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\Łukasz\AppData\Local\Programs\@comfyorgcomfyui-electron\resources\ComfyUI\comfy\text_encoders\t5.py", line 40, in __init__
self.wi_1 = operations.Linear(model_dim, ff_dim, bias=False, dtype=dtype, device=device)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\pinokio\api\Comfyui\.venv\Lib\site-packages\torch\nn\modules\linear.py", line 106, in __init__
torch.empty((out_features, in_features), **factory_kwargs)
torch.OutOfMemoryError: Allocation on device

2025-02-04T02:28:18.441230 - Got an OOM, unloading all loaded models.
2025-02-04T02:28:18.454593 - Prompt executed in 0.55 seconds

## Attached Workflow
Please make sure that workflow does not contain any sensitive information such as API keys or passwords.

{"last_node_id":41,"last_link_id":130,"nodes":[{"id":16,"type":"KSamplerSelect","pos":[480,912],"size":[315,58],"flags":{},"order":0,"mode":0,"inputs":[],"outputs":[{"name":"SAMPLER","type":"SAMPLER","links":[19],"shape":3,"label":"SAMPLER"}],"properties":{"Node name for S&R":"KSamplerSelect"},"widgets_values":["euler"]},{"id":30,"type":"ModelSamplingFlux","pos":[480,1152],"size":[315,130],"flags":{},"order":9,"mode":0,"inputs":[{"name":"model","type":"MODEL","link":56,"slot_index":0,"label":"model"},{"name":"width","type":"INT","link":115,"slot_index":1,"widget":{"name":"width"},"label":"width"},{"name":"height","type":"INT","link":114,"slot_index":2,"widget":{"name":"height"},"label":"height"}],"outputs":[{"name":"MODEL","type":"MODEL","links":[55],"slot_index":0,"shape":3,"label":"MODEL"}],"properties":{"Node name for S&R":"ModelSamplingFlux"},"widgets_values":[1.15,0.5,1392,1712]},{"id":8,"type":"VAEDecode","pos":[1277.5745849609375,241.4618377685547],"size":[210,46],"flags":{},"order":17,"mode":0,"inputs":[{"name":"samples","type":"LATENT","link":24,"label":"samples"},{"name":"vae","type":"VAE","link":12,"label":"vae"}],"outputs":[{"name":"IMAGE","type":"IMAGE","links":[9],"slot_index":0,"label":"IMAGE"}],"properties":{"Node name for S&R":"VAEDecode"},"widgets_values":[]},{"id":13,"type":"SamplerCustomAdvanced","pos":[906.1104736328125,211.06903076171875],"size":[272.3617858886719,124.53733825683594],"flags":{},"order":16,"mode":0,"inputs":[{"name":"noise","type":"NOISE","link":37,"slot_index":0,"label":"noise"},{"name":"guider","type":"GUIDER","link":127,"slot_index":1,"label":"guider"},{"name":"sampler","type":"SAMPLER","link":19,"slot_index":2,"label":"sampler"},{"name":"sigmas","type":"SIGMAS","link":20,"slot_index":3,"label":"sigmas"},{"name":"latent_image","type":"LATENT","link":116,"slot_index":4,"label":"latent_image"}],"outputs":[{"name":"output","type":"LATENT","links":[24],"slot_index":0,"shape":3,"label":"output"},{"name":"denoised_output","type":"LATENT","links":null,"shape":3,"label":"denoised_output"}],"properties":{"Node name for S&R":"SamplerCustomAdvanced"},"widgets_values":[]},{"id":27,"type":"EmptySD3LatentImage","pos":[485.56170654296875,612.8764038085938],"size":[315,106],"flags":{},"order":8,"mode":0,"inputs":[{"name":"width","type":"INT","link":112,"widget":{"name":"width"},"label":"width"},{"name":"height","type":"INT","link":113,"widget":{"name":"height"},"label":"height"}],"outputs":[{"name":"LATENT","type":"LATENT","links":[116],"slot_index":0,"shape":3,"label":"LATENT"}],"properties":{"Node name for S&R":"EmptySD3LatentImage"},"widgets_values":[1392,1712,1]},{"id":17,"type":"BasicScheduler","pos":[480,1008],"size":[315,106],"flags":{},"order":11,"mode":0,"inputs":[{"name":"model","type":"MODEL","link":55,"slot_index":0,"label":"model"}],"outputs":[{"name":"SIGMAS","type":"SIGMAS","links":[20],"shape":3,"label":"SIGMAS"}],"properties":{"Node name for S&R":"BasicScheduler"},"widgets_values":["simple",20,1]},{"id":40,"type":"CFGGuider","pos":[2041.7757568359375,-41.73738098144531],"size":[315,98],"flags":{},"order":15,"mode":0,"inputs":[{"name":"model","type":"MODEL","link":123},{"name":"positive","type":"CONDITIONING","link":130},{"name":"negative","type":"CONDITIONING","link":126}],"outputs":[{"name":"GUIDER","type":"GUIDER","links":[127],"slot_index":0}],"properties":{"Node name for S&R":"CFGGuider"},"widgets_values":[1.01]},{"id":39,"type":"CLIPTextEncode","pos":[810.628662109375,-24.575204849243164],"size":[422.84503173828125,164.31304931640625],"flags":{"collapsed":true},"order":13,"mode":0,"inputs":[{"name":"clip","type":"CLIP","link":121,"label":"clip"}],"outputs":[{"name":"CONDITIONING","type":"CONDITIONING","links":[126],"slot_index":0,"label":"CONDITIONING"}],"title":"CLIP Text Encode (NEgative Prompt)","properties":{"Node name for S&R":"CLIPTextEncode"},"widgets_values":[""],"color":"#322","bgcolor":"#533"},{"id":25,"type":"RandomNoise","pos":[480,768],"size":[315,82],"flags":{},"order":1,"mode":0,"inputs":[],"outputs":[{"name":"NOISE","type":"NOISE","links":[37],"shape":3,"label":"NOISE"}],"properties":{"Node name for S&R":"RandomNoise"},"widgets_values":[607280210647355,"randomize"],"color":"#2a363b","bgcolor":"#3f5159"},{"id":26,"type":"FluxGuidance","pos":[1449.265380859375,-213.46588134765625],"size":[317.4000244140625,58],"flags":{},"order":14,"mode":0,"inputs":[{"name":"conditioning","type":"CONDITIONING","link":129,"label":"conditioning"}],"outputs":[{"name":"CONDITIONING","type":"CONDITIONING","links":[130],"slot_index":0,"shape":3,"label":"CONDITIONING"}],"properties":{"Node name for S&R":"FluxGuidance"},"widgets_values":[3.4000000000000004],"color":"#233","bgcolor":"#355"},{"id":38,"type":"Power Lora Loader (rgthree)","pos":[254.0276641845703,-200.78903198242188],"size":[340.20001220703125,214],"flags":{},"order":10,"mode":0,"inputs":[{"name":"model","type":"MODEL","link":117,"dir":3},{"name":"clip","type":"CLIP","link":118,"dir":3}],"outputs":[{"name":"MODEL","type":"MODEL","links":[123],"slot_index":0,"shape":3,"dir":4},{"name":"CLIP","type":"CLIP","links":[120,121],"slot_index":1,"shape":3,"dir":4}],"properties":{"Show Strengths":"Single Strength"},"widgets_values":[null,{"type":"PowerLoraLoaderHeaderWidget"},{"on":true,"lora":"lukasz.safetensors","strength":1,"strengthTwo":null},{"on":false,"lora":"holoportraitv1.safetensors","strength":0.52,"strengthTwo":null},{"on":true,"lora":"Cyber_Room.safetensors","strength":0.4999999999999997,"strengthTwo":null},{"on":false,"lora":"Flux\\Mezzotint_Artstyle_for_Flux_-_by_Ethanar.safetensors","strength":0.5333343505859371,"strengthTwo":null},null,""]},{"id":34,"type":"PrimitiveNode","pos":[432,480],"size":[210,82],"flags":{},"order":2,"mode":0,"inputs":[],"outputs":[{"name":"INT","type":"INT","links":[112,115],"slot_index":0,"widget":{"name":"width"},"label":"INT"}],"title":"width","properties":{"Run widget replace on values":false},"widgets_values":[1392,"fixed"],"color":"#323","bgcolor":"#535"},{"id":35,"type":"PrimitiveNode","pos":[672,480],"size":[210,82],"flags":{},"order":3,"mode":0,"inputs":[],"outputs":[{"name":"INT","type":"INT","links":[113,114],"slot_index":0,"widget":{"name":"height"},"label":"INT"}],"title":"height","properties":{"Run widget replace on values":false},"widgets_values":[1712,"fixed"],"color":"#323","bgcolor":"#535"},{"id":9,"type":"SaveImage","pos":[1526.12060546875,180.73696899414062],"size":[985.3012084960938,1060.3828125],"flags":{},"order":18,"mode":0,"inputs":[{"name":"images","type":"IMAGE","link":9,"label":"images"}],"outputs":[],"properties":{"Node name for S&R":"SaveImage"},"widgets_values":["ComfyUI"]},{"id":10,"type":"VAELoader","pos":[42.75599670410156,458.219970703125],"size":[311.81634521484375,60.429901123046875],"flags":{},"order":4,"mode":0,"inputs":[],"outputs":[{"name":"VAE","type":"VAE","links":[12],"slot_index":0,"shape":3,"label":"VAE"}],"properties":{"Node name for S&R":"VAELoader"},"widgets_values":["ae.safetensors"]},{"id":11,"type":"DualCLIPLoader","pos":[48,288],"size":[315,106],"flags":{},"order":5,"mode":0,"inputs":[],"outputs":[{"name":"CLIP","type":"CLIP","links":[118],"slot_index":0,"shape":3,"label":"CLIP"}],"properties":{"Node name for S&R":"DualCLIPLoader"},"widgets_values":["t5xxl_fp16.safetensors","clip_l.safetensors","flux","default"]},{"id":12,"type":"UNETLoader","pos":[48,144],"size":[315,82],"flags":{},"order":6,"mode":0,"inputs":[],"outputs":[{"name":"MODEL","type":"MODEL","links":[56,117],"slot_index":0,"shape":3,"label":"MODEL"}],"properties":{"Node name for S&R":"UNETLoader"},"widgets_values":["flux1-dev.safetensors","fp8_e4m3fn"],"color":"#223","bgcolor":"#335"},{"id":6,"type":"CLIPTextEncode","pos":[830.5343627929688,-262.1523132324219],"size":[422.84503173828125,164.31304931640625],"flags":{},"order":12,"mode":0,"inputs":[{"name":"clip","type":"CLIP","link":120,"label":"clip"}],"outputs":[{"name":"CONDITIONING","type":"CONDITIONING","links":[129],"slot_index":0,"label":"CONDITIONING"}],"title":"CLIP Text Encode (Positive Prompt)","properties":{"Node name for S&R":"CLIPTextEncode"},"widgets_values":[""],"color":"#232","bgcolor":"#353"},{"id":37,"type":"Note","pos":[480,1344],"size":[314.99755859375,117.98363494873047],"flags":{},"order":7,"mode":0,"inputs":[],"outputs":[],"properties":{"text":""},"widgets_values":["The reference sampling implementation auto adjusts the shift value based on the resolution, if you don't want this you can just bypass (CTRL-B) this ModelSamplingFlux node.\n"],"color":"#432","bgcolor":"#653"}],"links":[[9,8,0,9,0,"IMAGE"],[12,10,0,8,1,"VAE"],[19,16,0,13,2,"SAMPLER"],[20,17,0,13,3,"SIGMAS"],[24,13,0,8,0,"LATENT"],[37,25,0,13,0,"NOISE"],[55,30,0,17,0,"MODEL"],[56,12,0,30,0,"MODEL"],[112,34,0,27,0,"INT"],[113,35,0,27,1,"INT"],[114,35,0,30,2,"INT"],[115,34,0,30,1,"INT"],[116,27,0,13,4,"LATENT"],[117,12,0,38,0,"MODEL"],[118,11,0,38,1,"CLIP"],[120,38,1,6,0,"CLIP"],[121,38,1,39,0,"CLIP"],[123,38,0,40,0,"MODEL"],[126,39,0,40,2,"CONDITIONING"],[127,40,0,13,1,"GUIDER"],[129,6,0,26,0,"CONDITIONING"],[130,26,0,40,1,"CONDITIONING"]],"groups":[],"config":{},"extra":{"ds":{"scale":0.7627768444385532,"offset":[820.170947246642,287.9786370387966]},"groupNodes":{}},"version":0.4}

## Additional Context
(Please add any additional context or steps to reproduce the error here)
```

### Other

_No response_

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the workflow with the reported ComfyUI 0.3.13 setup and inspect nodes.py at load_clip, then follow comfy/sd.py through load_text_encoder_state_dicts. Use the DualCLIPLoader stack trace and device memory details to identify why allocation fails; done means the reported pipeline loads and runs without the Allocation on device error.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
backend, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.