# ComfyUI Error Report ## Error Details - **Node ID:** 16 - **Node Type:** DownloadAndLoadHyVideoTextEncoder - **Exception Type:** torch.OutOfMemoryError - **Exception Message:** Allocation on device

# ComfyUI Error Report
## Error Details
- **Node ID:** 16
- **Node Type:** DownloadAndLoadHyVideoTextEncoder
- **Exception Type:** torch.OutOfMemoryError
- **Exception Message:** Allocation on device
## Stack Trace
```
File "/data/app/execution.py", line 327, in execute
output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)

File "/data/app/execution.py", line 202, in get_output_data
return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)

File "/data/app/execution.py", line 174, in _map_node_over_list
process_inputs(input_dict, i)

File "/data/app/execution.py", line 163, in process_inputs
results.append(getattr(obj, func)(**inputs))

File "/data/app/custom_nodes/ComfyUI-HunyuanVideoWrapper/nodes.py", line 623, in loadmodel
text_encoder = TextEncoder(

File "/data/app/custom_nodes/ComfyUI-HunyuanVideoWrapper/hyvideo/text_encoder/__init__.py", line 167, in __init__
self.model, self.model_path = load_text_encoder(

File "/data/app/custom_nodes/ComfyUI-HunyuanVideoWrapper/hyvideo/text_encoder/__init__.py", line 64, in load_text_encoder
text_encoder = text_encoder.to(device)

File "/data/miniconda3/pkgs/comfyui/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3164, in to
return super().to(*args, **kwargs)

File "/data/miniconda3/pkgs/comfyui/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1340, in to
return self._apply(convert)

File "/data/miniconda3/pkgs/comfyui/lib/python3.10/site-packages/torch/nn/modules/module.py", line 900, in _apply
module._apply(fn)

File "/data/miniconda3/pkgs/comfyui/lib/python3.10/site-packages/torch/nn/modules/module.py", line 900, in _apply
module._apply(fn)

File "/data/miniconda3/pkgs/comfyui/lib/python3.10/site-packages/torch/nn/modules/module.py", line 900, in _apply
module._apply(fn)

[Previous line repeated 1 more time]

File "/data/miniconda3/pkgs/comfyui/lib/python3.10/site-packages/torch/nn/modules/module.py", line 927, in _apply
param_applied = fn(param)

File "/data/miniconda3/pkgs/comfyui/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1326, in convert
return t.to(

```
## System Information
- **ComfyUI Version:** v0.3.10-11-g82ecb02c
- **Arguments:** /data/app/main.py --listen --port 30000
- **OS:** posix
- **Python Version:** 3.10.14 (main, Mar 21 2024, 16:24:04) [GCC 11.2.0]
- **Embedded Python:** false
- **PyTorch Version:** 2.5.1+cu124
## Devices

- **Name:** cuda:0 Tesla T4 : cudaMallocAsync
- **Type:** cuda
- **VRAM Total:** 15655829504
- **VRAM Free:** 213174362
- **Torch VRAM Total:** 15401484288
- **Torch VRAM Free:** 89835610

## Logs
```
2025-01-12T03:20:52.537531 - [START] Security scan2025-01-12T03:20:52.537636 -
2025-01-12T03:20:57.168875 - [DONE] Security scan2025-01-12T03:20:57.168911 -
2025-01-12T03:20:57.612680 - ## ComfyUI-Manager: installing dependencies done.2025-01-12T03:20:57.612728 -
2025-01-12T03:20:57.612751 - ** ComfyUI startup time:2025-01-12T03:20:57.612770 - 2025-01-12T03:20:57.612789 - 2025-01-12 03:20:57.6127382025-01-12T03:20:57.612806 -
2025-01-12T03:20:57.612825 - ** Platform:2025-01-12T03:20:57.612840 - 2025-01-12T03:20:57.612855 - Linux2025-01-12T03:20:57.612869 -
2025-01-12T03:20:57.612885 - ** Python version:2025-01-12T03:20:57.612899 - 2025-01-12T03:20:57.612913 - 3.10.14 (main, Mar 21 2024, 16:24:04) [GCC 11.2.0]2025-01-12T03:20:57.612927 -
2025-01-12T03:20:57.612942 - ** Python executable:2025-01-12T03:20:57.612956 - 2025-01-12T03:20:57.612977 - /data/miniconda3/pkgs/comfyui/bin/python2025-01-12T03:20:57.612991 -
2025-01-12T03:20:57.613006 - ** ComfyUI Path:2025-01-12T03:20:57.613020 - 2025-01-12T03:20:57.613034 - /data/app2025-01-12T03:20:57.613048 -
2025-01-12T03:20:57.613082 - ** Log path:2025-01-12T03:20:57.613096 - 2025-01-12T03:20:57.613110 - /data/app/comfyui.log2025-01-12T03:20:57.613124 -
2025-01-12T03:20:57.649481 -
Prestartup times for custom nodes:
2025-01-12T03:20:57.649614 - 5.3 seconds: /data/app/custom_nodes/ComfyUI-Manager
2025-01-12T03:20:57.649662 -
2025-01-12T03:21:02.968740 - Total VRAM 14931 MB, total RAM 15780 MB
2025-01-12T03:21:02.968872 - pytorch version: 2.5.1+cu124
2025-01-12T03:21:07.121757 - xformers version: 0.0.28.post3
2025-01-12T03:21:07.122055 - Set vram state to: NORMAL_VRAM
2025-01-12T03:21:07.122190 - Device: cuda:0 Tesla T4 : cudaMallocAsync
2025-01-12T03:21:07.649099 - Using xformers attention
2025-01-12T03:21:11.467601 - [Prompt Server] web root: /data/app/web
2025-01-12T03:21:21.930212 - ### Loading: ComfyUI-Manager (V2.50.2)2025-01-12T03:21:21.930348 -
2025-01-12T03:21:22.046391 - ### ComfyUI Revision: 2991 [82ecb02c] | Released on '2024-12-29'2025-01-12T03:21:22.046431 -
2025-01-12T03:21:22.123464 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/model-list.json2025-01-12T03:21:22.123531 -
2025-01-12T03:21:22.269857 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/alter-list.json2025-01-12T03:21:22.269985 -
2025-01-12T03:21:22.296133 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/github-stats.json2025-01-12T03:21:22.296191 -
2025-01-12T03:21:22.368566 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/custom-node-list.json2025-01-12T03:21:22.368649 -
2025-01-12T03:21:22.404648 - [ComfyUI-Manager] default cache updated: https://raw.githubusercontent.com/ltdrdata/ComfyUI-Manager/main/extension-node-map.json2025-01-12T03:21:22.404700 -
2025-01-12T03:21:22.916758 -
Import times for custom nodes:
2025-01-12T03:21:22.916892 - 0.2 seconds: /data/app/custom_nodes/ComfyUI-Manager
2025-01-12T03:21:22.916941 - 0.5 seconds: /data/app/custom_nodes/ComfyUI-Custom-Scripts
2025-01-12T03:21:22.916981 - 0.8 seconds: /data/app/custom_nodes/ComfyUI-VideoHelperSuite
2025-01-12T03:21:22.917019 - 7.2 seconds: /data/app/custom_nodes/ComfyUI-HunyuanVideoWrapper
2025-01-12T03:21:22.917056 -
2025-01-12T03:21:22.927572 - Starting server

2025-01-12T03:21:22.927875 - To see the GUI go to: http://0.0.0.0:30000
2025-01-12T03:21:22.928044 - To see the GUI go to: http://[::]:30000
2025-01-12T03:21:29.598985 - FETCH DATA from: /data/app/custom_nodes/ComfyUI-Manager/extension-node-map.json2025-01-12T03:21:29.599107 - 2025-01-12T03:21:29.605826 - [DONE]2025-01-12T03:21:29.605869 -
2025-01-12T03:22:38.942441 - got prompt
2025-01-12T03:22:43.417674 - Loading text encoder model (clipL) from: /data/app/models/clip/clip-vit-large-patch14
2025-01-12T03:22:48.030839 - Text encoder to dtype: torch.float16
2025-01-12T03:22:48.108129 - Loading tokenizer (clipL) from: /data/app/models/clip/clip-vit-large-patch14
2025-01-12T03:22:49.406716 - Loading text encoder model (llm) from: /data/app/models/LLM/llava-llama-3-8b-text-encoder-tokenizer
2025-01-12T03:26:37.196906 -
Loading checkpoint shards: 100%|██████████| 4/4 [03:44<00:00, 49.91s/it]2025-01-12T03:26:37.197259 -
Loading checkpoint shards: 100%|██████████| 4/4 [03:44<00:00, 56.12s/it]2025-01-12T03:26:37.197287 -
2025-01-12T03:33:27.910915 - Text encoder to dtype: torch.bfloat16
2025-01-12T03:33:37.570281 - !!! Exception during processing !!! Allocation on device
2025-01-12T03:33:37.844806 - Traceback (most recent call last):
File "/data/app/execution.py", line 327, in execute
output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
File "/data/app/execution.py", line 202, in get_output_data
return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
File "/data/app/execution.py", line 174, in _map_node_over_list
process_inputs(input_dict, i)
File "/data/app/execution.py", line 163, in process_inputs
results.append(getattr(obj, func)(**inputs))
File "/data/app/custom_nodes/ComfyUI-HunyuanVideoWrapper/nodes.py", line 623, in loadmodel
text_encoder = TextEncoder(
File "/data/app/custom_nodes/ComfyUI-HunyuanVideoWrapper/hyvideo/text_encoder/__init__.py", line 167, in __init__
self.model, self.model_path = load_text_encoder(
File "/data/app/custom_nodes/ComfyUI-HunyuanVideoWrapper/hyvideo/text_encoder/__init__.py", line 64, in load_text_encoder
text_encoder = text_encoder.to(device)
File "/data/miniconda3/pkgs/comfyui/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3164, in to
return super().to(*args, **kwargs)
File "/data/miniconda3/pkgs/comfyui/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1340, in to
return self._apply(convert)
File "/data/miniconda3/pkgs/comfyui/lib/python3.10/site-packages/torch/nn/modules/module.py", line 900, in _apply
module._apply(fn)
File "/data/miniconda3/pkgs/comfyui/lib/python3.10/site-packages/torch/nn/modules/module.py", line 900, in _apply
module._apply(fn)
File "/data/miniconda3/pkgs/comfyui/lib/python3.10/site-packages/torch/nn/modules/module.py", line 900, in _apply
module._apply(fn)
[Previous line repeated 1 more time]
File "/data/miniconda3/pkgs/comfyui/lib/python3.10/site-packages/torch/nn/modules/module.py", line 927, in _apply
param_applied = fn(param)
File "/data/miniconda3/pkgs/comfyui/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1326, in convert
return t.to(
torch.OutOfMemoryError: Allocation on device

2025-01-12T03:33:37.845860 - Got an OOM, unloading all loaded models.
2025-01-12T03:33:37.942966 - Prompt executed in 658.86 seconds

```
## Attached Workflow
Please make sure that workflow does not contain any sensitive information such as API keys or passwords.
```
{"last_node_id":42,"last_link_id":52,"nodes":[{"id":42,"type":"VHS_VideoCombine","pos":[515.49267578125,-300.38787841796875],"size":[458.9403991699219,310],"flags":{},"order":7,"mode":0,"inputs":[{"name":"images","type":"IMAGE","link":52},{"name":"audio","type":"AUDIO","link":null,"shape":7},{"name":"meta_batch","type":"VHS_BatchManager","link":null,"shape":7},{"name":"vae","type":"VAE","link":null,"shape":7}],"outputs":[{"name":"Filenames","type":"VHS_FILENAMES","links":null}],"properties":{"Node name for S&R":"VHS_VideoCombine"},"widgets_values":{"frame_rate":24,"loop_count":0,"filename_prefix":"HunyuanVideo","format":"video/h265-mp4","pix_fmt":"yuv420p10le","crf":22,"save_metadata":true,"pingpong":false,"save_output":true,"videopreview":{"hidden":false,"paused":false,"params":{"filename":"HunyuanVideo_00008.mp4","subfolder":"","type":"output","format":"video/h265-mp4","frame_rate":24,"workflow":"HunyuanVideo_00008.png"},"muted":false}}},{"id":1,"type":"HyVideoModelLoader","pos":[-377.8948669433594,-28.314847946166992],"size":[426.1773986816406,218],"flags":{},"order":4,"mode":0,"inputs":[{"name":"compile_args","type":"COMPILEARGS","link":null,"shape":7,"label":"compile_args"},{"name":"block_swap_args","type":"BLOCKSWAPARGS","link":null,"shape":7,"label":"block_swap_args"},{"name":"lora","type":"HYVIDLORA","link":51,"shape":7,"label":"lora"}],"outputs":[{"name":"model","type":"HYVIDEOMODEL","links":[2],"slot_index":0,"label":"model"}],"properties":{"Node name for S&R":"HyVideoModelLoader","enableTabs":false,"tabWidth":65,"tabXOffset":10,"hasSecondTab":false,"secondTabText":"Send Back","secondTabOffset":80,"secondTabWidth":65},"widgets_values":["hunyuan_video_720_cfgdistill_fp8_e4m3fn.safetensors","bf16","fp8_e4m3fn","offload_device","sageattn_varlen",false]},{"id":16,"type":"DownloadAndLoadHyVideoTextEncoder","pos":[-391.72735595703125,221.345947265625],"size":[441,178],"flags":{},"order":0,"mode":0,"inputs":[],"outputs":[{"name":"hyvid_text_encoder","type":"HYVIDTEXTENCODER","links":[35],"label":"hyvid_text_encoder"}],"properties":{"Node name for S&R":"DownloadAndLoadHyVideoTextEncoder","enableTabs":false,"tabWidth":65,"tabXOffset":10,"hasSecondTab":false,"secondTabText":"Send Back","secondTabOffset":80,"secondTabWidth":65},"widgets_values":["Kijai/llava-llama-3-8b-text-encoder-tokenizer","openai/clip-vit-large-patch14","bf16",false,2,"fp8_e4m3fn"]},{"id":7,"type":"HyVideoVAELoader","pos":[-364.65716552734375,-374.7846984863281],"size":[379.166748046875,82],"flags":{},"order":1,"mode":0,"inputs":[{"name":"compile_args","type":"COMPILEARGS","link":null,"shape":7,"label":"compile_args"}],"outputs":[{"name":"vae","type":"VAE","links":[6],"slot_index":0,"label":"vae"}],"properties":{"Node name for S&R":"HyVideoVAELoader","enableTabs":false,"tabWidth":65,"tabXOffset":10,"hasSecondTab":false,"secondTabText":"Send Back","secondTabOffset":80,"secondTabWidth":65},"widgets_values":["hunyuan_video_vae_bf16.safetensors","bf16"]},{"id":41,"type":"HyVideoLoraSelect","pos":[-368.57354736328125,-216.06932067871094],"size":[401.2055358886719,110.37236022949219],"flags":{},"order":2,"mode":0,"inputs":[{"name":"prev_lora","type":"HYVIDLORA","link":null,"shape":7,"label":"prev_lora"},{"name":"blocks","type":"SELECTEDBLOCKS","link":null,"shape":7,"label":"blocks"}],"outputs":[{"name":"lora","type":"HYVIDLORA","links":[51],"slot_index":0,"label":"lora"}],"properties":{"Node name for S&R":"HyVideoLoraSelect","enableTabs":false,"tabWidth":65,"tabXOffset":10,"hasSecondTab":false,"secondTabText":"Send Back","secondTabOffset":80,"secondTabWidth":65},"widgets_values":["hunyuanvideo2020arnold.aTQ1.safetensors",0.8]},{"id":5,"type":"HyVideoDecode","pos":[88.58671569824219,-403.5135192871094],"size":[345.4285888671875,150],"flags":{},"order":6,"mode":0,"inputs":[{"name":"vae","type":"VAE","link":6,"label":"vae"},{"name":"samples","type":"LATENT","link":4,"label":"samples"}],"outputs":[{"name":"images","type":"IMAGE","links":[52],"slot_index":0,"label":"images"}],"properties":{"Node name for S&R":"HyVideoDecode","enableTabs":false,"tabWidth":65,"tabXOffset":10,"hasSecondTab":false,"secondTabText":"Send Back","secondTabOffset":80,"secondTabWidth":65},"widgets_values":[true,64,256,true]},{"id":30,"type":"HyVideoTextEncode","pos":[522.1417236328125,127.87632751464844],"size":[435.6288757324219,256.3200378417969],"flags":{},"order":3,"mode":0,"inputs":[{"name":"text_encoders","type":"HYVIDTEXTENCODER","link":35,"label":"text_encoders"},{"name":"custom_prompt_template","type":"PROMPT_TEMPLATE","link":null,"shape":7,"label":"custom_prompt_template"},{"name":"clip_l","type":"CLIP","link":null,"shape":7,"label":"clip_l"},{"name":"hyvid_cfg","type":"HYVID_CFG","link":null,"shape":7}],"outputs":[{"name":"hyvid_embeds","type":"HYVIDEMBEDS","links":[36],"label":"hyvid_embeds"}],"properties":{"Node name for S&R":"HyVideoTextEncode","enableTabs":false,"tabWidth":65,"tabXOffset":10,"hasSecondTab":false,"secondTabText":"Send Back","secondTabOffset":80,"secondTabWidth":65},"widgets_values":["apple falling from a table","bad quality video","video"]},{"id":3,"type":"HyVideoSampler","pos":[130.89015197753906,-127.869873046875],"size":[315,586],"flags":{},"order":5,"mode":0,"inputs":[{"name":"model","type":"HYVIDEOMODEL","link":2,"label":"model"},{"name":"hyvid_embeds","type":"HYVIDEMBEDS","link":36,"label":"hyvid_embeds"},{"name":"samples","type":"LATENT","link":null,"shape":7,"label":"samples"},{"name":"stg_args","type":"STGARGS","link":null,"shape":7,"label":"stg_args"},{"name":"context_options","type":"COGCONTEXT","link":null,"shape":7},{"name":"feta_args","type":"FETAARGS","link":null,"shape":7}],"outputs":[{"name":"samples","type":"LATENT","links":[4],"slot_index":0,"label":"samples"}],"properties":{"Node name for S&R":"HyVideoSampler","enableTabs":false,"tabWidth":65,"tabXOffset":10,"hasSecondTab":false,"secondTabText":"Send Back","secondTabOffset":80,"secondTabWidth":65},"widgets_values":[544,368,85,30,6,9,6,"fixed",1,1]}],"links":[[2,1,0,3,0,"HYVIDEOMODEL"],[4,3,0,5,1,"LATENT"],[6,7,0,5,0,"VAE"],[35,16,0,30,0,"HYVIDTEXTENCODER"],[36,30,0,3,1,"HYVIDEMBEDS"],[51,41,0,1,2,"HYVIDLORA"],[52,5,0,42,0,"IMAGE"]],"groups":[{"id":1,"title":"txt2video","bounding":[-401.72735595703125,-483.7685546875,1430.082763671875,964.8690795898438],"color":"#3f789e","font_size":24,"flags":{}}],"config":{},"extra":{"ds":{"scale":1.3310000000000004,"offset":[208.03114420060615,259.9102105870793]},"workspace_info":{"id":"dX01LyaM36dqzHfEgfIJ-","saveLock":false,"cloudID":null,"coverMediaPath":null},"VHS_latentpreview":false,"VHS_latentpreviewrate":0},"version":0.4}
```

## Additional Context
(Please add any additional context or steps to reproduce the error here)