torch.OutOfMemoryError: Allocation on device 2024-12-04T15:20:36.382480 - Got an OOM, unloading all loaded models. 2024-12-04T15:20:36.793480 - Prompt executed in 3.14 seconds

### Your question

torch.OutOfMemoryError: Allocation on device

2024-12-04T15:20:36.382480 - Got an OOM, unloading all loaded models.
2024-12-04T15:20:36.793480 - Prompt executed in 3.14 seconds

### Logs

```powershell
# ComfyUI Error Report
## Error Details
- **Node ID:** 207
- **Node Type:** MimicMotionSampler
- **Exception Type:** torch.OutOfMemoryError
- **Exception Message:** Allocation on device
## Stack Trace

File "D:\pinokio\api\comfy.git\app\execution.py", line 323, in execute
output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)

File "D:\pinokio\api\comfy.git\app\execution.py", line 198, in get_output_data
return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)

File "D:\pinokio\api\comfy.git\app\execution.py", line 169, in _map_node_over_list
process_inputs(input_dict, i)

File "D:\pinokio\api\comfy.git\app\execution.py", line 158, in process_inputs
results.append(getattr(obj, func)(**inputs))

File "D:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-MimicMotionWrapper\nodes.py", line 300, in process
frames = pipeline(

File "D:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\utils\_contextlib.py", line 116, in decorate_context
return func(*args, **kwargs)

File "D:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-MimicMotionWrapper\mimicmotion\pipelines\pipeline_mimicmotion.py", line 661, in __call__
_noise_pred = self.unet(

File "D:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1736, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)

File "D:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1747, in _call_impl
return forward_call(*args, **kwargs)

File "D:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-MimicMotionWrapper\mimicmotion\modules\unet.py", line 454, in forward
sample, res_samples = downsample_block(

File "D:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1736, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)

File "D:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1747, in _call_impl
return forward_call(*args, **kwargs)

File "D:\pinokio\api\comfy.git\app\env\lib\site-packages\diffusers\models\unets\unet_3d_blocks.py", line 1316, in forward
hidden_states = attn(

File "D:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1736, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)

File "D:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1747, in _call_impl
return forward_call(*args, **kwargs)

File "D:\pinokio\api\comfy.git\app\env\lib\site-packages\diffusers\models\transformers\transformer_temporal.py", line 353, in forward
hidden_states = block(

File "D:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1736, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)

File "D:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1747, in _call_impl
return forward_call(*args, **kwargs)

File "D:\pinokio\api\comfy.git\app\env\lib\site-packages\diffusers\models\attention.py", line 571, in forward
ff_output = self.ff(norm_hidden_states)

File "D:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1736, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)

File "D:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1747, in _call_impl
return forward_call(*args, **kwargs)

File "D:\pinokio\api\comfy.git\app\env\lib\site-packages\diffusers\models\attention.py", line 1242, in forward
hidden_states = module(hidden_states)

File "D:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1736, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)

File "D:\pinokio\api\comfy.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1747, in _call_impl
return forward_call(*args, **kwargs)

File "D:\pinokio\api\comfy.git\app\env\lib\site-packages\diffusers\models\activations.py", line 123, in forward
return hidden_states * self.gelu(gate)

File "D:\pinokio\api\comfy.git\app\env\lib\site-packages\diffusers\models\activations.py", line 109, in gelu
return F.gelu(gate)

```
## System Information
- **ComfyUI Version:** v0.3.4-6-g61196d8
- **Arguments:** main.py
- **OS:** nt
- **Python Version:** 3.10.15 | packaged by conda-forge | (main, Oct 16 2024, 01:15:49) [MSC v.1941 64 bit (AMD64)]
- **Embedded Python:** false
- **PyTorch Version:** 2.5.1+cu121
## Devices

- **Name:** cuda:0 NVIDIA GeForce RTX 3060 : cudaMallocAsync
- **Type:** cuda
- **VRAM Total:** 12884377600
- **VRAM Free:** 1949360544
- **Torch VRAM Total:** 10502537216
- **Torch VRAM Free:** 854253984

## Logs
```
2024-12-04T15:10:34.058504 - [START] Security scan2024-12-04T15:10:34.058504 -
2024-12-04T15:10:37.443349 - [DONE] Security scan2024-12-04T15:10:37.443349 -
2024-12-04T15:10:37.725336 - ## ComfyUI-Manager: installing dependencies done.2024-12-04T15:10:37.726337 -
2024-12-04T15:10:37.726337 - ** ComfyUI startup time:2024-12-04T15:10:37.726337 - 2024-12-04T15:10:37.726337 - 2024-12-04 15:10:37.7263372024-12-04T15:10:37.727337 -
2024-12-04T15:10:37.757329 - ** Platform:2024-12-04T15:10:37.757329 - 2024-12-04T15:10:37.757329 - Windows2024-12-04T15:10:37.758334 -
2024-12-04T15:10:37.758334 - ** Python version:2024-12-04T15:10:37.758334 - 2024-12-04T15:10:37.758334 - 3.10.15 | packaged by conda-forge | (main, Oct 16 2024, 01:15:49) [MSC v.1941 64 bit (AMD64)]2024-12-04T15:10:37.758334 -
2024-12-04T15:10:37.759335 - ** Python executable:2024-12-04T15:10:37.759335 - 2024-12-04T15:10:37.759335 - D:\pinokio\api\comfy.git\app\env\Scripts\python.exe2024-12-04T15:10:37.759335 -
2024-12-04T15:10:37.759335 - ** ComfyUI Path:2024-12-04T15:10:37.759335 - 2024-12-04T15:10:37.760335 - D:\pinokio\api\comfy.git\app2024-12-04T15:10:37.760335 -
2024-12-04T15:10:37.760335 - ** Log path:2024-12-04T15:10:37.760335 - 2024-12-04T15:10:37.760335 - D:\pinokio\api\comfy.git\app\comfyui.log2024-12-04T15:10:37.760335 -
2024-12-04T15:10:42.780341 -
Prestartup times for custom nodes:2024-12-04T15:10:42.780341 -
2024-12-04T15:10:42.781350 - 8.8 seconds:2024-12-04T15:10:42.781350 - 2024-12-04T15:10:42.788363 - D:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-Manager2024-12-04T15:10:42.788363 -
2024-12-04T15:10:42.789353 -
2024-12-04T15:10:47.389044 - Total VRAM 12288 MB, total RAM 65415 MB
2024-12-04T15:10:47.390044 - pytorch version: 2.5.1+cu121
2024-12-04T15:10:47.392045 - Set vram state to: NORMAL_VRAM
2024-12-04T15:10:47.393045 - Device: cuda:0 NVIDIA GeForce RTX 3060 : cudaMallocAsync
2024-12-04T15:10:50.394231 - Using pytorch cross attention
2024-12-04T15:10:54.795429 - [Prompt Server] web root: D:\pinokio\api\comfy.git\app\web
2024-12-04T15:10:57.435057 - [Crystools INFO] Crystools version: 1.21.0
2024-12-04T15:10:57.492050 - [Crystools INFO] CPU: Intel(R) Xeon(R) CPU E5-2683 v4 @ 2.10GHz - Arch: AMD64 - OS: Windows 10
2024-12-04T15:10:57.511060 - [Crystools INFO] Pynvml (Nvidia) initialized.
2024-12-04T15:10:57.511060 - [Crystools INFO] GPU/s:
2024-12-04T15:10:57.518074 - [Crystools INFO] 0) NVIDIA GeForce RTX 3060
2024-12-04T15:10:57.518074 - [Crystools INFO] NVIDIA Driver: 560.94
2024-12-04T15:10:57.584059 - Total VRAM 12288 MB, total RAM 65415 MB
2024-12-04T15:10:57.585053 - pytorch version: 2.5.1+cu121
2024-12-04T15:10:57.587058 - Set vram state to: NORMAL_VRAM
2024-12-04T15:10:57.588059 - Device: cuda:0 NVIDIA GeForce RTX 3060 : cudaMallocAsync
2024-12-04T15:10:57.841051 - ### Loading: ComfyUI-Manager (V2.52)2024-12-04T15:10:57.841051 -
2024-12-04T15:10:58.038023 - ### ComfyUI Revision: 2860 [61196d88] | Released on '2024-11-25'2024-12-04T15:10:58.039021 -
2024-12-04T15:10:58.486756 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/alter-list.json2024-12-04T15:10:58.486756 -
2024-12-04T15:10:58.509738 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/model-list.json2024-12-04T15:10:58.509738 -
2024-12-04T15:10:58.546739 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/github-stats.json2024-12-04T15:10:58.547738 -
2024-12-04T15:10:58.626705 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json2024-12-04T15:10:58.627705 -
2024-12-04T15:10:58.694702 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/extension-node-map.json2024-12-04T15:10:58.695705 -
2024-12-04T15:11:00.792675 - D:\pinokio\api\comfy.git\app\env\lib\site-packages\albumentations\__init__.py:13: UserWarning: A new version of Albumentations is available: 1.4.21 (you have 1.4.15). Upgrade using: pip install -U albumentations. To disable automatic update checks, set the environment variable NO_ALBUMENTATIONS_UPDATE to 1.
check_for_updates()
2024-12-04T15:11:01.577173 - [ReActor] - STATUS - Running v0.5.2-a1 in ComfyUI2024-12-04T15:11:01.578196 -
2024-12-04T15:11:02.627916 - Torch version: 2.5.1+cu1212024-12-04T15:11:02.627916 -
2024-12-04T15:11:03.312650 - [comfyui_controlnet_aux] | INFO -> Using ckpts path: D:\pinokio\api\comfy.git\app\custom_nodes\comfyui_controlnet_aux\ckpts
2024-12-04T15:11:03.313655 - [comfyui_controlnet_aux] | INFO -> Using symlinks: False
2024-12-04T15:11:03.314629 - [comfyui_controlnet_aux] | INFO -> Using ort providers: ['CUDAExecutionProvider', 'DirectMLExecutionProvider', 'OpenVINOExecutionProvider', 'ROCMExecutionProvider', 'CPUExecutionProvider', 'CoreMLExecutionProvider']
2024-12-04T15:11:03.962656 - DWPose: Onnxruntime with acceleration providers detected2024-12-04T15:11:03.962656 -
2024-12-04T15:11:04.749229 -
Import times for custom nodes:
2024-12-04T15:11:04.750235 - 0.0 seconds: D:\pinokio\api\comfy.git\app\custom_nodes\websocket_image_save.py
2024-12-04T15:11:04.750235 - 0.0 seconds: D:\pinokio\api\comfy.git\app\custom_nodes\comfyui-lama-remover
2024-12-04T15:11:04.751235 - 0.0 seconds: D:\pinokio\api\comfy.git\app\custom_nodes\comfyui-model-downloader
2024-12-04T15:11:04.751235 - 0.0 seconds: D:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI_essentials
2024-12-04T15:11:04.751235 - 0.0 seconds: D:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-Frame-Interpolation
2024-12-04T15:11:04.752232 - 0.0 seconds: D:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-Advanced-ControlNet
2024-12-04T15:11:04.752232 - 0.1 seconds: D:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-LivePortraitKJ
2024-12-04T15:11:04.753233 - 0.1 seconds: D:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-AnimateDiff-Evolved
2024-12-04T15:11:04.753233 - 0.2 seconds: D:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-Model-Manager
2024-12-04T15:11:04.754244 - 0.2 seconds: D:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-KJNodes
2024-12-04T15:11:04.754244 - 0.4 seconds: D:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-VideoHelperSuite
2024-12-04T15:11:04.754244 - 0.5 seconds: D:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-Manager
2024-12-04T15:11:04.755233 - 0.7 seconds: D:\pinokio\api\comfy.git\app\custom_nodes\comfyui_segment_anything
2024-12-04T15:11:04.755233 - 0.7 seconds: D:\pinokio\api\comfy.git\app\custom_nodes\comfyui_controlnet_aux
2024-12-04T15:11:04.756234 - 0.9 seconds: D:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-MimicMotionWrapper
2024-12-04T15:11:04.756234 - 0.9 seconds: D:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-Crystools
2024-12-04T15:11:04.756234 - 3.5 seconds: D:\pinokio\api\comfy.git\app\custom_nodes\comfyui-reactor-node
2024-12-04T15:11:04.757232 -
2024-12-04T15:11:04.778262 - Starting server

2024-12-04T15:11:04.779234 - To see the GUI go to: http://127.0.0.1:8188
2024-12-04T15:12:21.892142 - Exception in callback _ProactorBasePipeTransport._call_connection_lost(None)
handle:
Traceback (most recent call last):
File "D:\pinokio\bin\miniconda\lib\asyncio\events.py", line 80, in _run
self._context.run(self._callback, *self._args)
File "D:\pinokio\bin\miniconda\lib\asyncio\proactor_events.py", line 165, in _call_connection_lost
self._sock.shutdown(socket.SHUT_RDWR)
ConnectionResetError: [WinError 10054] An existing connection was forcibly closed by the remote host
2024-12-04T15:12:21.894182 - Exception in callback _ProactorBasePipeTransport._call_connection_lost(None)
handle:
Traceback (most recent call last):
File "D:\pinokio\bin\miniconda\lib\asyncio\events.py", line 80, in _run
self._context.run(self._callback, *self._args)
File "D:\pinokio\bin\miniconda\lib\asyncio\proactor_events.py", line 165, in _call_connection_lost
self._sock.shutdown(socket.SHUT_RDWR)
ConnectionResetError: [WinError 10054] An existing connection was forcibly closed by the remote host
2024-12-04T15:12:55.371860 - Exception in callback _ProactorBasePipeTransport._call_connection_lost(None)
handle:
Traceback (most recent call last):
File "D:\pinokio\bin\miniconda\lib\asyncio\events.py", line 80, in _run
self._context.run(self._callback, *self._args)
File "D:\pinokio\bin\miniconda\lib\asyncio\proactor_events.py", line 165, in _call_connection_lost
self._sock.shutdown(socket.SHUT_RDWR)
ConnectionResetError: [WinError 10054] An existing connection was forcibly closed by the remote host
2024-12-04T15:12:58.442243 - got prompt
2024-12-04T15:12:58.637241 - Failed to validate prompt for output 284:
2024-12-04T15:12:58.638207 - * CheckpointLoaderSimple 243:
2024-12-04T15:12:58.638207 - - Value not in list: ckpt_name: 'juggernaut_reborn.safetensors' not in ['flux1-dev-bnb-nf4.safetensors', 'flux1-schnell-fp8.safetensors', 'ltx-2b-v0.9-bf16.safetensors', 'ltx-video-2b-v0.9-fp8_e4m3fn.safetensors', 'ltx-video-2b-v0.9.safetensors', 'sd15\\realisticVisionV60B1_v51VAE.safetensors', 'sd_xl_base_1.0.safetensors', 'sd_xl_refiner_1.0.safetensors']
2024-12-04T15:12:58.639207 - Output will be ignored
2024-12-04T15:12:58.639207 - Failed to validate prompt for output 213:
2024-12-04T15:12:58.639207 - Output will be ignored
2024-12-04T15:13:11.497754 - Prompt executed in 12.70 seconds
2024-12-04T15:13:11.755754 - Exception in callback _ProactorBasePipeTransport._call_connection_lost(None)
handle:
Traceback (most recent call last):
File "D:\pinokio\bin\miniconda\lib\asyncio\events.py", line 80, in _run
self._context.run(self._callback, *self._args)
File "D:\pinokio\bin\miniconda\lib\asyncio\proactor_events.py", line 165, in _call_connection_lost
self._sock.shutdown(socket.SHUT_RDWR)
ConnectionResetError: [WinError 10054] An existing connection was forcibly closed by the remote host
2024-12-04T15:15:07.706127 - FETCH DATA from: D:\pinokio\api\comfy.git\app\custom_nodes\ComfyUI-Manager\extension-node-map.json2024-12-04T15:15:07.706127 - 2024-12-04T15:15:07.714112 - [DONE]2024-12-04T15:15:07.714112 -
2024-12-04T15:15:08.479126 - Exception in callback _ProactorBasePipeTransport._call_connection_lost(None)
handle:
Traceback (most recent call last):
File "D:\pinokio\bin\miniconda\lib\asyncio\events.py", line 80, in _run
self._context.run(self._callback, *self._args)
File "D:\pinokio\bin\miniconda\lib\asyncio\proactor_events.py", line 165, in _call_connection_lost
self._sock.shutdown(socket.SHUT_RDWR)
ConnectionResetError: [WinError 10054] An existing connection was forcibly closed by the remote host
2024-12-04T15:15:14.825001 - got prompt
2024-12-04T15:15:15.554070 - model weight dtype torch.float16, manual cast: None
2024-12-04T15:15:15.557066 - model_type EPS
2024-12-04T15:15:16.693970 - Using pytorch attention in VAE
2024-12-04T15:15:16.698984 - Using pytorch attention in VAE
2024-12-04T15:15:17.672376 - xFormers not available
2024-12-04T15:15:17.680376 - xFormers not available
2024-12-04T15:15:17.687376 - model_path is D:\pinokio\api\comfy.git\app\custom_nodes\comfyui_controlnet_aux\ckpts\depth-anything/Depth-Anything-V2-Large\depth_anything_v2_vitl.pth2024-12-04T15:15:17.688376 -
2024-12-04T15:15:17.701377 - using MLP layer as FFN
2024-12-04T15:15:28.178738 - Requested to load SD1ClipModel
2024-12-04T15:15:28.179740 - Loading 1 new model
2024-12-04T15:15:28.271739 - loaded completely 0.0 235.84423828125 True
2024-12-04T15:15:28.476741 - Requested to load ControlNet
2024-12-04T15:15:28.477747 - Requested to load BaseModel
2024-12-04T15:15:28.477747 - Loading 2 new models
2024-12-04T15:15:28.683745 - loaded completely 0.0 689.0852355957031 True
2024-12-04T15:15:29.344845 - loaded completely 0.0 1639.406135559082 True
2024-12-04T15:15:38.374890 -
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 35/35 [00:08<00:00, 4.04it/s]2024-12-04T15:15:38.375879 -
100%|██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 35/35 [00:08<00:00, 3.90it/s]2024-12-04T15:15:38.376856 -
2024-12-04T15:15:38.378874 - Requested to load AutoencoderKL
2024-12-04T15:15:38.378874 - Loading 1 new model
2024-12-04T15:15:38.611872 - loaded completely 0.0 159.55708122253418 True
2024-12-04T15:15:39.524904 - LandmarkRunner warmup time: 0.062s2024-12-04T15:15:39.524904 -
2024-12-04T15:15:40.207858 - LivePortrait using fp16
2024-12-04T15:15:40.256825 - Load appearance_feature_extractor done.
2024-12-04T15:15:40.710887 - Load motion_extractor done.
2024-12-04T15:15:41.335009 - Load warping_module done.
2024-12-04T15:15:42.180170 - Load spade_generator done.
2024-12-04T15:15:42.195154 - Load stitching_retargeting_module done.
2024-12-04T15:16:15.525650 -
Detecting, cropping, and processing..: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 248/248 [00:32<00:00, 7.54it/s]2024-12-04T15:16:15.526667 -
Detecting, cropping, and processing..: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 248/248 [00:32<00:00, 7.56it/s]2024-12-04T15:16:15.527651 -
2024-12-04T15:17:25.501589 - Loading model from: D:\pinokio\api\comfy.git\app\models\mimicmotion\MimicMotionMergedUnet_1-1-fp16.safetensors
2024-12-04T15:17:25.504589 - Loading UNET
2024-12-04T15:17:29.315626 - Loading VAE
2024-12-04T15:17:30.093437 - Loading IMAGE_ENCODER
2024-12-04T15:17:32.991142 - Loading POSE_NET
2024-12-04T15:17:35.602174 - Using optional scheduler: EulerDiscreteScheduler {
"_class_name": "EulerDiscreteScheduler",
"_diffusers_version": "0.31.0",
"beta_end": 0.012,
"beta_schedule": "scaled_linear",
"beta_start": 0.00085,
"clip_sample": false,
"final_sigmas_type": "zero",
"interpolation_type": "linear",
"num_train_timesteps": 1000,
"prediction_type": "v_prediction",
"rescale_betas_zero_snr": false,
"set_alpha_to_one": false,
"sigma_max": 700.0,
"sigma_min": 0.002,
"skip_prk_steps": true,
"steps_offset": 1,
"timestep_spacing": "leading",
"timestep_type": "continuous",
"trained_betas": null,
"use_beta_sigmas": false,
"use_exponential_sigmas": false,
"use_karras_sigmas": true
}

2024-12-04T15:17:36.496214 - num_frames: 2024-12-04T15:17:36.497213 - 2024-12-04T15:17:36.498225 - 1252024-12-04T15:17:36.498225 -
2024-12-04T15:17:37.769896 - start_step_index: 0, end_step_index: 102024-12-04T15:17:37.770911 -
2024-12-04T15:17:37.809900 -
0%| | 0/20 [00:00