Possible Bug with updated pytorch?

Open

#10,115 opened on Sep 30, 2025 0 comments 0 reactions 0 assignees View on GitHub

Potential Bug

Dominant language: Python
Stars: 133k
Forks: 15.7k
Avg merge: 1d 7h
Merged PRs (30d): 158

Description

### Custom Node Testing

- [x] I have tried disabling custom nodes and the issue persists (see [how to disable custom nodes](https://docs.comfy.org/troubleshooting/custom-node-issues#step-1%3A-test-with-all-custom-nodes-disabled) if you need help)

### Expected Behavior

KSamplerAdvanced
torch.* op returned non-Tensor
Explanation: torch.* ops that return a non-Tensor cannot be traced into the Dynamo FX graph output

### Actual Behavior

Keep getting this error regardless, and I think its because its not compatible with the updated PyTorch?

### Steps to Reproduce

[WanImg22Vid-v11.json](https://github.com/user-attachments/files/22611160/WanImg22Vid-v11.json)

### Debug Logs

```powershell
# ComfyUI Error Report
## Error Details
- **Node ID:** 36
- **Node Type:** KSamplerAdvanced
- **Exception Type:** torch._dynamo.exc.Unsupported
- **Exception Message:** torch.* op returned non-Tensor
Explanation: torch.* ops that return a non-Tensor cannot be traced into the Dynamo FX graph output

Developer debug context: example_value type: int; op: call_function; target:

from user code:
File "D:\ComfyUI\ComfyUI\comfy\ldm\wan\model.py", line 235, in forward
y = self.self_attn(
File "D:\ComfyUI\ComfyUI\comfy\ldm\wan\model.py", line 81, in forward
x = optimized_attention(
File "D:\ComfyUI\ComfyUI\comfy\ldm\modules\attention.py", line 130, in wrapper
return func(*args, **kwargs)
File "D:\ComfyUI\ComfyUI\comfy\ldm\modules\attention.py", line 541, in attention_sage
out = sageattn(q, k, v, attn_mask=mask, is_causal=False, tensor_layout=tensor_layout)
File "D:\ComfyUI\python_embeded\Lib\site-packages\sageattention\core.py", line 143, in sageattn
arch = get_cuda_arch_versions()[q.device.index]
File "D:\ComfyUI\python_embeded\Lib\site-packages\torch\_dynamo\polyfills\__init__.py", line 193, in getattr_and_trace
return fn(*args[2:], **kwargs)
File "D:\ComfyUI\python_embeded\Lib\site-packages\sageattention\core.py", line 74, in get_cuda_arch_versions
for i in range(torch.cuda.device_count()):

Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo"

## Stack Trace

File "D:\ComfyUI\ComfyUI\execution.py", line 496, in execute
output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, hidden_inputs=hidden_inputs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\ComfyUI\execution.py", line 315, in get_output_data
return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, hidden_inputs=hidden_inputs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\ComfyUI\execution.py", line 289, in _async_map_node_over_list
await process_inputs(input_dict, i)

File "D:\ComfyUI\ComfyUI\execution.py", line 277, in process_inputs
result = f(**inputs)

File "D:\ComfyUI\ComfyUI\nodes.py", line 1559, in sample
return common_ksampler(model, noise_seed, steps, cfg, sampler_name, scheduler, positive, negative, latent_image, denoise=denoise, disable_noise=disable_noise, start_step=start_at_step, last_step=end_at_step, force_full_denoise=force_full_denoise)

File "D:\ComfyUI\ComfyUI\nodes.py", line 1492, in common_ksampler
samples = comfy.sample.sample(model, noise, steps, cfg, sampler_name, scheduler, positive, negative, latent_image,
denoise=denoise, disable_noise=disable_noise, start_step=start_step, last_step=last_step,
force_full_denoise=force_full_denoise, noise_mask=noise_mask, callback=callback, disable_pbar=disable_pbar, seed=seed)

File "D:\ComfyUI\ComfyUI\comfy\sample.py", line 45, in sample
samples = sampler.sample(noise, positive, negative, cfg=cfg, latent_image=latent_image, start_step=start_step, last_step=last_step, force_full_denoise=force_full_denoise, denoise_mask=noise_mask, sigmas=sigmas, callback=callback, disable_pbar=disable_pbar, seed=seed)

File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 1161, in sample
return sample(self.model, noise, positive, negative, cfg, self.device, sampler, sigmas, self.model_options, latent_image=latent_image, denoise_mask=denoise_mask, callback=callback, disable_pbar=disable_pbar, seed=seed)

File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 1051, in sample
return cfg_guider.sample(noise, latent_image, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)
~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 1036, in sample
output = executor.execute(noise, latent_image, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)

File "D:\ComfyUI\ComfyUI\comfy\patcher_extension.py", line 112, in execute
return self.original(*args, **kwargs)
~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 1004, in outer_sample
output = self.inner_sample(noise, latent_image, device, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)

File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 987, in inner_sample
samples = executor.execute(self, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar)

File "D:\ComfyUI\ComfyUI\comfy\patcher_extension.py", line 112, in execute
return self.original(*args, **kwargs)
~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 759, in sample
samples = self.sampler_function(model_k, noise, sigmas, extra_args=extra_args, callback=k_callback, disable=disable_pbar, **self.extra_options)

File "D:\ComfyUI\ComfyUI\custom_nodes\RES4LYF\beta\__init__.py", line 167, in sample_res_2s
return rk_sampler_beta.sample_rk_beta(model, x, sigmas, None, extra_args, callback, disable, rk_type="res_2s",)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\python_embeded\Lib\site-packages\torch\utils\_contextlib.py", line 120, in decorate_context
return func(*args, **kwargs)

File "D:\ComfyUI\ComfyUI\custom_nodes\RES4LYF\beta\rk_sampler_beta.py", line 1665, in sample_rk_beta
eps_[row], data_[row] = RK(x_tmp, s_tmp, x_0, sigma, transformer_options={'row': row, 'x_tmp': x_tmp, 'sigma_next': sigma_next})
~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\ComfyUI\custom_nodes\RES4LYF\beta\rk_method_beta.py", line 901, in __call__
denoised = self.model_denoised(x.to(self.model_device), sub_sigma.to(self.model_device), **self.extra_args).to(sigma.device)
~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\ComfyUI\custom_nodes\RES4LYF\beta\rk_method_beta.py", line 241, in model_denoised
denoised = self.model(x, sigma * s_in, **extra_args)

File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 408, in __call__
out = self.inner_model(x, sigma, model_options=model_options, seed=seed)

File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 960, in __call__
return self.outer_predict_noise(*args, **kwargs)
~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 967, in outer_predict_noise
).execute(x, timestep, model_options, seed)
~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\ComfyUI\comfy\patcher_extension.py", line 112, in execute
return self.original(*args, **kwargs)
~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 970, in predict_noise
return sampling_function(self.inner_model, x, timestep, self.conds.get("negative", None), self.conds.get("positive", None), self.cfg, model_options=model_options, seed=seed)

File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 388, in sampling_function
out = calc_cond_batch(model, conds, x, timestep, model_options)

File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 206, in calc_cond_batch
return _calc_cond_batch_outer(model, conds, x_in, timestep, model_options)

File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 214, in _calc_cond_batch_outer
return executor.execute(model, conds, x_in, timestep, model_options)
~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\ComfyUI\comfy\patcher_extension.py", line 112, in execute
return self.original(*args, **kwargs)
~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 333, in _calc_cond_batch
output = model.apply_model(input_x, timestep_, **c).chunk(batch_chunks)
~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\ComfyUI\comfy\model_base.py", line 160, in apply_model
return comfy.patcher_extension.WrapperExecutor.new_class_executor(
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
...<2 lines>...
comfy.patcher_extension.get_all_wrappers(comfy.patcher_extension.WrappersMP.APPLY_MODEL, transformer_options)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
).execute(x, t, c_concat, c_crossattn, control, transformer_options, **kwargs)
~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\ComfyUI\comfy\patcher_extension.py", line 113, in execute
return self.wrappers[self.idx](self, *args, **kwargs)
~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\ComfyUI\comfy_api\torch_helpers\torch_compile.py", line 26, in apply_torch_compile_wrapper
return executor(*args, **kwargs)

File "D:\ComfyUI\ComfyUI\comfy\patcher_extension.py", line 105, in __call__
return new_executor.execute(*args, **kwargs)
~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\ComfyUI\comfy\patcher_extension.py", line 112, in execute
return self.original(*args, **kwargs)
~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\ComfyUI\comfy\model_base.py", line 199, in _apply_model
model_output = self.diffusion_model(xc, t, context=context, control=control, transformer_options=transformer_options, **extra_conds).float()
~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1773, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1784, in _call_impl
return forward_call(*args, **kwargs)

File "D:\ComfyUI\ComfyUI\comfy\ldm\wan\model.py", line 614, in forward
return comfy.patcher_extension.WrapperExecutor.new_class_executor(
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
...<2 lines>...
comfy.patcher_extension.get_all_wrappers(comfy.patcher_extension.WrappersMP.DIFFUSION_MODEL, transformer_options)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
).execute(x, timestep, context, clip_fea, time_dim_concat, transformer_options, **kwargs)
~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\ComfyUI\comfy\patcher_extension.py", line 112, in execute
return self.original(*args, **kwargs)
~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\ComfyUI\comfy\ldm\wan\model.py", line 634, in _forward
return self.forward_orig(x, timestep, context, clip_fea=clip_fea, freqs=freqs, transformer_options=transformer_options, **kwargs)[:, :, :t, :h, :w]
~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\ComfyUI\comfy\ldm\wan\model.py", line 579, in forward_orig
x = block(x, e=e0, freqs=freqs, context=context, context_img_len=context_img_len, transformer_options=transformer_options)

File "D:\ComfyUI\python_embeded\Lib\site-packages\torch\_dynamo\eval_frame.py", line 375, in __call__
return super().__call__(*args, **kwargs)
~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1773, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^

File "D:\ComfyUI\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1784, in _call_impl
return forward_call(*args, **kwargs)

File "D:\ComfyUI\python_embeded\Lib\site-packages\torch\_dynamo\eval_frame.py", line 745, in compile_wrapper
raise e.with_traceback(None) from e.__cause__ # User compiler error
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

## System Information
- **ComfyUI Version:** 0.3.61
- **Arguments:** ComfyUI\main.py --fast fp16_accumulation --disable-auto-launch --use-sage-attention --listen 0.0.0.0 --cuda-device 0
- **OS:** nt
- **Python Version:** 3.13.6 (tags/v3.13.6:4e66535, Aug 6 2025, 14:36:00) [MSC v.1944 64 bit (AMD64)]
- **Embedded Python:** true
- **PyTorch Version:** 2.8.0+cu129
## Devices

- **Name:** cuda:0 NVIDIA GeForce RTX 5090 : cudaMallocAsync
- **Type:** cuda
- **VRAM Total:** 34190458880
- **VRAM Free:** 4036690396
- **Torch VRAM Total:** 28353495040
- **Torch VRAM Free:** 165347804

## Logs

2025-09-30T00:01:54.999111 - lora key not loaded: transformer.transformer_blocks.3.attn.to_v.lora.down.weight
2025-09-30T00:01:54.999384 - lora key not loaded: transformer.transformer_blocks.3.attn.to_v.lora.up.weight
2025-09-30T00:01:54.999644 - lora key not loaded: transformer.transformer_blocks.30.attn.to_k.lora.down.weight
2025-09-30T00:01:55.000020 - lora key not loaded: transformer.transformer_blocks.30.attn.to_k.lora.up.weight
2025-09-30T00:01:55.000296 - lora key not loaded: transformer.transformer_blocks.30.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.000575 - lora key not loaded: transformer.transformer_blocks.30.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.000875 - lora key not loaded: transformer.transformer_blocks.30.attn.to_q.lora.down.weight
2025-09-30T00:01:55.001137 - lora key not loaded: transformer.transformer_blocks.30.attn.to_q.lora.up.weight
2025-09-30T00:01:55.001432 - lora key not loaded: transformer.transformer_blocks.30.attn.to_v.lora.down.weight
2025-09-30T00:01:55.001708 - lora key not loaded: transformer.transformer_blocks.30.attn.to_v.lora.up.weight
2025-09-30T00:01:55.001961 - lora key not loaded: transformer.transformer_blocks.31.attn.to_k.lora.down.weight
2025-09-30T00:01:55.002243 - lora key not loaded: transformer.transformer_blocks.31.attn.to_k.lora.up.weight
2025-09-30T00:01:55.002529 - lora key not loaded: transformer.transformer_blocks.31.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.002792 - lora key not loaded: transformer.transformer_blocks.31.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.003059 - lora key not loaded: transformer.transformer_blocks.31.attn.to_q.lora.down.weight
2025-09-30T00:01:55.003330 - lora key not loaded: transformer.transformer_blocks.31.attn.to_q.lora.up.weight
2025-09-30T00:01:55.003597 - lora key not loaded: transformer.transformer_blocks.31.attn.to_v.lora.down.weight
2025-09-30T00:01:55.003879 - lora key not loaded: transformer.transformer_blocks.31.attn.to_v.lora.up.weight
2025-09-30T00:01:55.004152 - lora key not loaded: transformer.transformer_blocks.32.attn.to_k.lora.down.weight
2025-09-30T00:01:55.004456 - lora key not loaded: transformer.transformer_blocks.32.attn.to_k.lora.up.weight
2025-09-30T00:01:55.005000 - lora key not loaded: transformer.transformer_blocks.32.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.005824 - lora key not loaded: transformer.transformer_blocks.32.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.006388 - lora key not loaded: transformer.transformer_blocks.32.attn.to_q.lora.down.weight
2025-09-30T00:01:55.006704 - lora key not loaded: transformer.transformer_blocks.32.attn.to_q.lora.up.weight
2025-09-30T00:01:55.007072 - lora key not loaded: transformer.transformer_blocks.32.attn.to_v.lora.down.weight
2025-09-30T00:01:55.007487 - lora key not loaded: transformer.transformer_blocks.32.attn.to_v.lora.up.weight
2025-09-30T00:01:55.007791 - lora key not loaded: transformer.transformer_blocks.33.attn.to_k.lora.down.weight
2025-09-30T00:01:55.008173 - lora key not loaded: transformer.transformer_blocks.33.attn.to_k.lora.up.weight
2025-09-30T00:01:55.008624 - lora key not loaded: transformer.transformer_blocks.33.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.009120 - lora key not loaded: transformer.transformer_blocks.33.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.009598 - lora key not loaded: transformer.transformer_blocks.33.attn.to_q.lora.down.weight
2025-09-30T00:01:55.010080 - lora key not loaded: transformer.transformer_blocks.33.attn.to_q.lora.up.weight
2025-09-30T00:01:55.010601 - lora key not loaded: transformer.transformer_blocks.33.attn.to_v.lora.down.weight
2025-09-30T00:01:55.010953 - lora key not loaded: transformer.transformer_blocks.33.attn.to_v.lora.up.weight
2025-09-30T00:01:55.011380 - lora key not loaded: transformer.transformer_blocks.34.attn.to_k.lora.down.weight
2025-09-30T00:01:55.012122 - lora key not loaded: transformer.transformer_blocks.34.attn.to_k.lora.up.weight
2025-09-30T00:01:55.012516 - lora key not loaded: transformer.transformer_blocks.34.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.012847 - lora key not loaded: transformer.transformer_blocks.34.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.013167 - lora key not loaded: transformer.transformer_blocks.34.attn.to_q.lora.down.weight
2025-09-30T00:01:55.013414 - lora key not loaded: transformer.transformer_blocks.34.attn.to_q.lora.up.weight
2025-09-30T00:01:55.013711 - lora key not loaded: transformer.transformer_blocks.34.attn.to_v.lora.down.weight
2025-09-30T00:01:55.014084 - lora key not loaded: transformer.transformer_blocks.34.attn.to_v.lora.up.weight
2025-09-30T00:01:55.014412 - lora key not loaded: transformer.transformer_blocks.35.attn.to_k.lora.down.weight
2025-09-30T00:01:55.014757 - lora key not loaded: transformer.transformer_blocks.35.attn.to_k.lora.up.weight
2025-09-30T00:01:55.015089 - lora key not loaded: transformer.transformer_blocks.35.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.015461 - lora key not loaded: transformer.transformer_blocks.35.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.015723 - lora key not loaded: transformer.transformer_blocks.35.attn.to_q.lora.down.weight
2025-09-30T00:01:55.015998 - lora key not loaded: transformer.transformer_blocks.35.attn.to_q.lora.up.weight
2025-09-30T00:01:55.016280 - lora key not loaded: transformer.transformer_blocks.35.attn.to_v.lora.down.weight
2025-09-30T00:01:55.016569 - lora key not loaded: transformer.transformer_blocks.35.attn.to_v.lora.up.weight
2025-09-30T00:01:55.017067 - lora key not loaded: transformer.transformer_blocks.36.attn.to_k.lora.down.weight
2025-09-30T00:01:55.017324 - lora key not loaded: transformer.transformer_blocks.36.attn.to_k.lora.up.weight
2025-09-30T00:01:55.017576 - lora key not loaded: transformer.transformer_blocks.36.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.017851 - lora key not loaded: transformer.transformer_blocks.36.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.018133 - lora key not loaded: transformer.transformer_blocks.36.attn.to_q.lora.down.weight
2025-09-30T00:01:55.018465 - lora key not loaded: transformer.transformer_blocks.36.attn.to_q.lora.up.weight
2025-09-30T00:01:55.018781 - lora key not loaded: transformer.transformer_blocks.36.attn.to_v.lora.down.weight
2025-09-30T00:01:55.019202 - lora key not loaded: transformer.transformer_blocks.36.attn.to_v.lora.up.weight
2025-09-30T00:01:55.019476 - lora key not loaded: transformer.transformer_blocks.37.attn.to_k.lora.down.weight
2025-09-30T00:01:55.019765 - lora key not loaded: transformer.transformer_blocks.37.attn.to_k.lora.up.weight
2025-09-30T00:01:55.020027 - lora key not loaded: transformer.transformer_blocks.37.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.020321 - lora key not loaded: transformer.transformer_blocks.37.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.020583 - lora key not loaded: transformer.transformer_blocks.37.attn.to_q.lora.down.weight
2025-09-30T00:01:55.020849 - lora key not loaded: transformer.transformer_blocks.37.attn.to_q.lora.up.weight
2025-09-30T00:01:55.021149 - lora key not loaded: transformer.transformer_blocks.37.attn.to_v.lora.down.weight
2025-09-30T00:01:55.021424 - lora key not loaded: transformer.transformer_blocks.37.attn.to_v.lora.up.weight
2025-09-30T00:01:55.021690 - lora key not loaded: transformer.transformer_blocks.38.attn.to_k.lora.down.weight
2025-09-30T00:01:55.021955 - lora key not loaded: transformer.transformer_blocks.38.attn.to_k.lora.up.weight
2025-09-30T00:01:55.022271 - lora key not loaded: transformer.transformer_blocks.38.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.022561 - lora key not loaded: transformer.transformer_blocks.38.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.022811 - lora key not loaded: transformer.transformer_blocks.38.attn.to_q.lora.down.weight
2025-09-30T00:01:55.023080 - lora key not loaded: transformer.transformer_blocks.38.attn.to_q.lora.up.weight
2025-09-30T00:01:55.023349 - lora key not loaded: transformer.transformer_blocks.38.attn.to_v.lora.down.weight
2025-09-30T00:01:55.023620 - lora key not loaded: transformer.transformer_blocks.38.attn.to_v.lora.up.weight
2025-09-30T00:01:55.023887 - lora key not loaded: transformer.transformer_blocks.39.attn.to_k.lora.down.weight
2025-09-30T00:01:55.024165 - lora key not loaded: transformer.transformer_blocks.39.attn.to_k.lora.up.weight
2025-09-30T00:01:55.024428 - lora key not loaded: transformer.transformer_blocks.39.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.024695 - lora key not loaded: transformer.transformer_blocks.39.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.024961 - lora key not loaded: transformer.transformer_blocks.39.attn.to_q.lora.down.weight
2025-09-30T00:01:55.025231 - lora key not loaded: transformer.transformer_blocks.39.attn.to_q.lora.up.weight
2025-09-30T00:01:55.025511 - lora key not loaded: transformer.transformer_blocks.39.attn.to_v.lora.down.weight
2025-09-30T00:01:55.025779 - lora key not loaded: transformer.transformer_blocks.39.attn.to_v.lora.up.weight
2025-09-30T00:01:55.026052 - lora key not loaded: transformer.transformer_blocks.4.attn.to_k.lora.down.weight
2025-09-30T00:01:55.026353 - lora key not loaded: transformer.transformer_blocks.4.attn.to_k.lora.up.weight
2025-09-30T00:01:55.026634 - lora key not loaded: transformer.transformer_blocks.4.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.027070 - lora key not loaded: transformer.transformer_blocks.4.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.027993 - lora key not loaded: transformer.transformer_blocks.4.attn.to_q.lora.down.weight
2025-09-30T00:01:55.028207 - lora key not loaded: transformer.transformer_blocks.4.attn.to_q.lora.up.weight
2025-09-30T00:01:55.028547 - lora key not loaded: transformer.transformer_blocks.4.attn.to_v.lora.down.weight
2025-09-30T00:01:55.028862 - lora key not loaded: transformer.transformer_blocks.4.attn.to_v.lora.up.weight
2025-09-30T00:01:55.029208 - lora key not loaded: transformer.transformer_blocks.40.attn.to_k.lora.down.weight
2025-09-30T00:01:55.039251 - lora key not loaded: transformer.transformer_blocks.40.attn.to_k.lora.up.weight
2025-09-30T00:01:55.039486 - lora key not loaded: transformer.transformer_blocks.40.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.039772 - lora key not loaded: transformer.transformer_blocks.40.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.040055 - lora key not loaded: transformer.transformer_blocks.40.attn.to_q.lora.down.weight
2025-09-30T00:01:55.040337 - lora key not loaded: transformer.transformer_blocks.40.attn.to_q.lora.up.weight
2025-09-30T00:01:55.040607 - lora key not loaded: transformer.transformer_blocks.40.attn.to_v.lora.down.weight
2025-09-30T00:01:55.040875 - lora key not loaded: transformer.transformer_blocks.40.attn.to_v.lora.up.weight
2025-09-30T00:01:55.041143 - lora key not loaded: transformer.transformer_blocks.41.attn.to_k.lora.down.weight
2025-09-30T00:01:55.041414 - lora key not loaded: transformer.transformer_blocks.41.attn.to_k.lora.up.weight
2025-09-30T00:01:55.041680 - lora key not loaded: transformer.transformer_blocks.41.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.041973 - lora key not loaded: transformer.transformer_blocks.41.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.042321 - lora key not loaded: transformer.transformer_blocks.41.attn.to_q.lora.down.weight
2025-09-30T00:01:55.042532 - lora key not loaded: transformer.transformer_blocks.41.attn.to_q.lora.up.weight
2025-09-30T00:01:55.043018 - lora key not loaded: transformer.transformer_blocks.41.attn.to_v.lora.down.weight
2025-09-30T00:01:55.043951 - lora key not loaded: transformer.transformer_blocks.41.attn.to_v.lora.up.weight
2025-09-30T00:01:55.044678 - lora key not loaded: transformer.transformer_blocks.42.attn.to_k.lora.down.weight
2025-09-30T00:01:55.044948 - lora key not loaded: transformer.transformer_blocks.42.attn.to_k.lora.up.weight
2025-09-30T00:01:55.045277 - lora key not loaded: transformer.transformer_blocks.42.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.045621 - lora key not loaded: transformer.transformer_blocks.42.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.045956 - lora key not loaded: transformer.transformer_blocks.42.attn.to_q.lora.down.weight
2025-09-30T00:01:55.046259 - lora key not loaded: transformer.transformer_blocks.42.attn.to_q.lora.up.weight
2025-09-30T00:01:55.046552 - lora key not loaded: transformer.transformer_blocks.42.attn.to_v.lora.down.weight
2025-09-30T00:01:55.046842 - lora key not loaded: transformer.transformer_blocks.42.attn.to_v.lora.up.weight
2025-09-30T00:01:55.047108 - lora key not loaded: transformer.transformer_blocks.43.attn.to_k.lora.down.weight
2025-09-30T00:01:55.047361 - lora key not loaded: transformer.transformer_blocks.43.attn.to_k.lora.up.weight
2025-09-30T00:01:55.047630 - lora key not loaded: transformer.transformer_blocks.43.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.047982 - lora key not loaded: transformer.transformer_blocks.43.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.048237 - lora key not loaded: transformer.transformer_blocks.43.attn.to_q.lora.down.weight
2025-09-30T00:01:55.048533 - lora key not loaded: transformer.transformer_blocks.43.attn.to_q.lora.up.weight
2025-09-30T00:01:55.049386 - lora key not loaded: transformer.transformer_blocks.43.attn.to_v.lora.down.weight
2025-09-30T00:01:55.050867 - lora key not loaded: transformer.transformer_blocks.43.attn.to_v.lora.up.weight
2025-09-30T00:01:55.051411 - lora key not loaded: transformer.transformer_blocks.44.attn.to_k.lora.down.weight
2025-09-30T00:01:55.051759 - lora key not loaded: transformer.transformer_blocks.44.attn.to_k.lora.up.weight
2025-09-30T00:01:55.052014 - lora key not loaded: transformer.transformer_blocks.44.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.052308 - lora key not loaded: transformer.transformer_blocks.44.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.052577 - lora key not loaded: transformer.transformer_blocks.44.attn.to_q.lora.down.weight
2025-09-30T00:01:55.052843 - lora key not loaded: transformer.transformer_blocks.44.attn.to_q.lora.up.weight
2025-09-30T00:01:55.053127 - lora key not loaded: transformer.transformer_blocks.44.attn.to_v.lora.down.weight
2025-09-30T00:01:55.053400 - lora key not loaded: transformer.transformer_blocks.44.attn.to_v.lora.up.weight
2025-09-30T00:01:55.053688 - lora key not loaded: transformer.transformer_blocks.45.attn.to_k.lora.down.weight
2025-09-30T00:01:55.053974 - lora key not loaded: transformer.transformer_blocks.45.attn.to_k.lora.up.weight
2025-09-30T00:01:55.054290 - lora key not loaded: transformer.transformer_blocks.45.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.054616 - lora key not loaded: transformer.transformer_blocks.45.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.054981 - lora key not loaded: transformer.transformer_blocks.45.attn.to_q.lora.down.weight
2025-09-30T00:01:55.055203 - lora key not loaded: transformer.transformer_blocks.45.attn.to_q.lora.up.weight
2025-09-30T00:01:55.055479 - lora key not loaded: transformer.transformer_blocks.45.attn.to_v.lora.down.weight
2025-09-30T00:01:55.055743 - lora key not loaded: transformer.transformer_blocks.45.attn.to_v.lora.up.weight
2025-09-30T00:01:55.056009 - lora key not loaded: transformer.transformer_blocks.46.attn.to_k.lora.down.weight
2025-09-30T00:01:55.056281 - lora key not loaded: transformer.transformer_blocks.46.attn.to_k.lora.up.weight
2025-09-30T00:01:55.056579 - lora key not loaded: transformer.transformer_blocks.46.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.057502 - lora key not loaded: transformer.transformer_blocks.46.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.057800 - lora key not loaded: transformer.transformer_blocks.46.attn.to_q.lora.down.weight
2025-09-30T00:01:55.058042 - lora key not loaded: transformer.transformer_blocks.46.attn.to_q.lora.up.weight
2025-09-30T00:01:55.058310 - lora key not loaded: transformer.transformer_blocks.46.attn.to_v.lora.down.weight
2025-09-30T00:01:55.058577 - lora key not loaded: transformer.transformer_blocks.46.attn.to_v.lora.up.weight
2025-09-30T00:01:55.058842 - lora key not loaded: transformer.transformer_blocks.47.attn.to_k.lora.down.weight
2025-09-30T00:01:55.059141 - lora key not loaded: transformer.transformer_blocks.47.attn.to_k.lora.up.weight
2025-09-30T00:01:55.059995 - lora key not loaded: transformer.transformer_blocks.47.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.060224 - lora key not loaded: transformer.transformer_blocks.47.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.060490 - lora key not loaded: transformer.transformer_blocks.47.attn.to_q.lora.down.weight
2025-09-30T00:01:55.060756 - lora key not loaded: transformer.transformer_blocks.47.attn.to_q.lora.up.weight
2025-09-30T00:01:55.061025 - lora key not loaded: transformer.transformer_blocks.47.attn.to_v.lora.down.weight
2025-09-30T00:01:55.061310 - lora key not loaded: transformer.transformer_blocks.47.attn.to_v.lora.up.weight
2025-09-30T00:01:55.061602 - lora key not loaded: transformer.transformer_blocks.48.attn.to_k.lora.down.weight
2025-09-30T00:01:55.062065 - lora key not loaded: transformer.transformer_blocks.48.attn.to_k.lora.up.weight
2025-09-30T00:01:55.062298 - lora key not loaded: transformer.transformer_blocks.48.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.062886 - lora key not loaded: transformer.transformer_blocks.48.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.063109 - lora key not loaded: transformer.transformer_blocks.48.attn.to_q.lora.down.weight
2025-09-30T00:01:55.063402 - lora key not loaded: transformer.transformer_blocks.48.attn.to_q.lora.up.weight
2025-09-30T00:01:55.063663 - lora key not loaded: transformer.transformer_blocks.48.attn.to_v.lora.down.weight
2025-09-30T00:01:55.063940 - lora key not loaded: transformer.transformer_blocks.48.attn.to_v.lora.up.weight
2025-09-30T00:01:55.064191 - lora key not loaded: transformer.transformer_blocks.49.attn.to_k.lora.down.weight
2025-09-30T00:01:55.064468 - lora key not loaded: transformer.transformer_blocks.49.attn.to_k.lora.up.weight
2025-09-30T00:01:55.065196 - lora key not loaded: transformer.transformer_blocks.49.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.065598 - lora key not loaded: transformer.transformer_blocks.49.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.065868 - lora key not loaded: transformer.transformer_blocks.49.attn.to_q.lora.down.weight
2025-09-30T00:01:55.066128 - lora key not loaded: transformer.transformer_blocks.49.attn.to_q.lora.up.weight
2025-09-30T00:01:55.066395 - lora key not loaded: transformer.transformer_blocks.49.attn.to_v.lora.down.weight
2025-09-30T00:01:55.066678 - lora key not loaded: transformer.transformer_blocks.49.attn.to_v.lora.up.weight
2025-09-30T00:01:55.066942 - lora key not loaded: transformer.transformer_blocks.5.attn.to_k.lora.down.weight
2025-09-30T00:01:55.067203 - lora key not loaded: transformer.transformer_blocks.5.attn.to_k.lora.up.weight
2025-09-30T00:01:55.067470 - lora key not loaded: transformer.transformer_blocks.5.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.067753 - lora key not loaded: transformer.transformer_blocks.5.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.068022 - lora key not loaded: transformer.transformer_blocks.5.attn.to_q.lora.down.weight
2025-09-30T00:01:55.068289 - lora key not loaded: transformer.transformer_blocks.5.attn.to_q.lora.up.weight
2025-09-30T00:01:55.068557 - lora key not loaded: transformer.transformer_blocks.5.attn.to_v.lora.down.weight
2025-09-30T00:01:55.068826 - lora key not loaded: transformer.transformer_blocks.5.attn.to_v.lora.up.weight
2025-09-30T00:01:55.069095 - lora key not loaded: transformer.transformer_blocks.50.attn.to_k.lora.down.weight
2025-09-30T00:01:55.069362 - lora key not loaded: transformer.transformer_blocks.50.attn.to_k.lora.up.weight
2025-09-30T00:01:55.069631 - lora key not loaded: transformer.transformer_blocks.50.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.069938 - lora key not loaded: transformer.transformer_blocks.50.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.070222 - lora key not loaded: transformer.transformer_blocks.50.attn.to_q.lora.down.weight
2025-09-30T00:01:55.070466 - lora key not loaded: transformer.transformer_blocks.50.attn.to_q.lora.up.weight
2025-09-30T00:01:55.070733 - lora key not loaded: transformer.transformer_blocks.50.attn.to_v.lora.down.weight
2025-09-30T00:01:55.071001 - lora key not loaded: transformer.transformer_blocks.50.attn.to_v.lora.up.weight
2025-09-30T00:01:55.071271 - lora key not loaded: transformer.transformer_blocks.51.attn.to_k.lora.down.weight
2025-09-30T00:01:55.071538 - lora key not loaded: transformer.transformer_blocks.51.attn.to_k.lora.up.weight
2025-09-30T00:01:55.071807 - lora key not loaded: transformer.transformer_blocks.51.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.072082 - lora key not loaded: transformer.transformer_blocks.51.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.072351 - lora key not loaded: transformer.transformer_blocks.51.attn.to_q.lora.down.weight
2025-09-30T00:01:55.072629 - lora key not loaded: transformer.transformer_blocks.51.attn.to_q.lora.up.weight
2025-09-30T00:01:55.073759 - lora key not loaded: transformer.transformer_blocks.51.attn.to_v.lora.down.weight
2025-09-30T00:01:55.074015 - lora key not loaded: transformer.transformer_blocks.51.attn.to_v.lora.up.weight
2025-09-30T00:01:55.074736 - lora key not loaded: transformer.transformer_blocks.52.attn.to_k.lora.down.weight
2025-09-30T00:01:55.075039 - lora key not loaded: transformer.transformer_blocks.52.attn.to_k.lora.up.weight
2025-09-30T00:01:55.075227 - lora key not loaded: transformer.transformer_blocks.52.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.075498 - lora key not loaded: transformer.transformer_blocks.52.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.075765 - lora key not loaded: transformer.transformer_blocks.52.attn.to_q.lora.down.weight
2025-09-30T00:01:55.076033 - lora key not loaded: transformer.transformer_blocks.52.attn.to_q.lora.up.weight
2025-09-30T00:01:55.076300 - lora key not loaded: transformer.transformer_blocks.52.attn.to_v.lora.down.weight
2025-09-30T00:01:55.076569 - lora key not loaded: transformer.transformer_blocks.52.attn.to_v.lora.up.weight
2025-09-30T00:01:55.076838 - lora key not loaded: transformer.transformer_blocks.53.attn.to_k.lora.down.weight
2025-09-30T00:01:55.077107 - lora key not loaded: transformer.transformer_blocks.53.attn.to_k.lora.up.weight
2025-09-30T00:01:55.077375 - lora key not loaded: transformer.transformer_blocks.53.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.077650 - lora key not loaded: transformer.transformer_blocks.53.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.077908 - lora key not loaded: transformer.transformer_blocks.53.attn.to_q.lora.down.weight
2025-09-30T00:01:55.078218 - lora key not loaded: transformer.transformer_blocks.53.attn.to_q.lora.up.weight
2025-09-30T00:01:55.078485 - lora key not loaded: transformer.transformer_blocks.53.attn.to_v.lora.down.weight
2025-09-30T00:01:55.078806 - lora key not loaded: transformer.transformer_blocks.53.attn.to_v.lora.up.weight
2025-09-30T00:01:55.079107 - lora key not loaded: transformer.transformer_blocks.54.attn.to_k.lora.down.weight
2025-09-30T00:01:55.079421 - lora key not loaded: transformer.transformer_blocks.54.attn.to_k.lora.up.weight
2025-09-30T00:01:55.079673 - lora key not loaded: transformer.transformer_blocks.54.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.079943 - lora key not loaded: transformer.transformer_blocks.54.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.080207 - lora key not loaded: transformer.transformer_blocks.54.attn.to_q.lora.down.weight
2025-09-30T00:01:55.080505 - lora key not loaded: transformer.transformer_blocks.54.attn.to_q.lora.up.weight
2025-09-30T00:01:55.081181 - lora key not loaded: transformer.transformer_blocks.54.attn.to_v.lora.down.weight
2025-09-30T00:01:55.081792 - lora key not loaded: transformer.transformer_blocks.54.attn.to_v.lora.up.weight
2025-09-30T00:01:55.082045 - lora key not loaded: transformer.transformer_blocks.55.attn.to_k.lora.down.weight
2025-09-30T00:01:55.082299 - lora key not loaded: transformer.transformer_blocks.55.attn.to_k.lora.up.weight
2025-09-30T00:01:55.082552 - lora key not loaded: transformer.transformer_blocks.55.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.082818 - lora key not loaded: transformer.transformer_blocks.55.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.083077 - lora key not loaded: transformer.transformer_blocks.55.attn.to_q.lora.down.weight
2025-09-30T00:01:55.083346 - lora key not loaded: transformer.transformer_blocks.55.attn.to_q.lora.up.weight
2025-09-30T00:01:55.083609 - lora key not loaded: transformer.transformer_blocks.55.attn.to_v.lora.down.weight
2025-09-30T00:01:55.083880 - lora key not loaded: transformer.transformer_blocks.55.attn.to_v.lora.up.weight
2025-09-30T00:01:55.084142 - lora key not loaded: transformer.transformer_blocks.56.attn.to_k.lora.down.weight
2025-09-30T00:01:55.084411 - lora key not loaded: transformer.transformer_blocks.56.attn.to_k.lora.up.weight
2025-09-30T00:01:55.084674 - lora key not loaded: transformer.transformer_blocks.56.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.084948 - lora key not loaded: transformer.transformer_blocks.56.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.085213 - lora key not loaded: transformer.transformer_blocks.56.attn.to_q.lora.down.weight
2025-09-30T00:01:55.085481 - lora key not loaded: transformer.transformer_blocks.56.attn.to_q.lora.up.weight
2025-09-30T00:01:55.085745 - lora key not loaded: transformer.transformer_blocks.56.attn.to_v.lora.down.weight
2025-09-30T00:01:55.086012 - lora key not loaded: transformer.transformer_blocks.56.attn.to_v.lora.up.weight
2025-09-30T00:01:55.086280 - lora key not loaded: transformer.transformer_blocks.57.attn.to_k.lora.down.weight
2025-09-30T00:01:55.086548 - lora key not loaded: transformer.transformer_blocks.57.attn.to_k.lora.up.weight
2025-09-30T00:01:55.086814 - lora key not loaded: transformer.transformer_blocks.57.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.087082 - lora key not loaded: transformer.transformer_blocks.57.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.087348 - lora key not loaded: transformer.transformer_blocks.57.attn.to_q.lora.down.weight
2025-09-30T00:01:55.087615 - lora key not loaded: transformer.transformer_blocks.57.attn.to_q.lora.up.weight
2025-09-30T00:01:55.087885 - lora key not loaded: transformer.transformer_blocks.57.attn.to_v.lora.down.weight
2025-09-30T00:01:55.088159 - lora key not loaded: transformer.transformer_blocks.57.attn.to_v.lora.up.weight
2025-09-30T00:01:55.088454 - lora key not loaded: transformer.transformer_blocks.58.attn.to_k.lora.down.weight
2025-09-30T00:01:55.089236 - lora key not loaded: transformer.transformer_blocks.58.attn.to_k.lora.up.weight
2025-09-30T00:01:55.089741 - lora key not loaded: transformer.transformer_blocks.58.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.090216 - lora key not loaded: transformer.transformer_blocks.58.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.090983 - lora key not loaded: transformer.transformer_blocks.58.attn.to_q.lora.down.weight
2025-09-30T00:01:55.091350 - lora key not loaded: transformer.transformer_blocks.58.attn.to_q.lora.up.weight
2025-09-30T00:01:55.091681 - lora key not loaded: transformer.transformer_blocks.58.attn.to_v.lora.down.weight
2025-09-30T00:01:55.091967 - lora key not loaded: transformer.transformer_blocks.58.attn.to_v.lora.up.weight
2025-09-30T00:01:55.092189 - lora key not loaded: transformer.transformer_blocks.59.attn.to_k.lora.down.weight
2025-09-30T00:01:55.092454 - lora key not loaded: transformer.transformer_blocks.59.attn.to_k.lora.up.weight
2025-09-30T00:01:55.092717 - lora key not loaded: transformer.transformer_blocks.59.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.092983 - lora key not loaded: transformer.transformer_blocks.59.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.093248 - lora key not loaded: transformer.transformer_blocks.59.attn.to_q.lora.down.weight
2025-09-30T00:01:55.093514 - lora key not loaded: transformer.transformer_blocks.59.attn.to_q.lora.up.weight
2025-09-30T00:01:55.093786 - lora key not loaded: transformer.transformer_blocks.59.attn.to_v.lora.down.weight
2025-09-30T00:01:55.094067 - lora key not loaded: transformer.transformer_blocks.59.attn.to_v.lora.up.weight
2025-09-30T00:01:55.094327 - lora key not loaded: transformer.transformer_blocks.6.attn.to_k.lora.down.weight
2025-09-30T00:01:55.094594 - lora key not loaded: transformer.transformer_blocks.6.attn.to_k.lora.up.weight
2025-09-30T00:01:55.094929 - lora key not loaded: transformer.transformer_blocks.6.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.095185 - lora key not loaded: transformer.transformer_blocks.6.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.095503 - lora key not loaded: transformer.transformer_blocks.6.attn.to_q.lora.down.weight
2025-09-30T00:01:55.095830 - lora key not loaded: transformer.transformer_blocks.6.attn.to_q.lora.up.weight
2025-09-30T00:01:55.096081 - lora key not loaded: transformer.transformer_blocks.6.attn.to_v.lora.down.weight
2025-09-30T00:01:55.096347 - lora key not loaded: transformer.transformer_blocks.6.attn.to_v.lora.up.weight
2025-09-30T00:01:55.096627 - lora key not loaded: transformer.transformer_blocks.7.attn.to_k.lora.down.weight
2025-09-30T00:01:55.097569 - lora key not loaded: transformer.transformer_blocks.7.attn.to_k.lora.up.weight
2025-09-30T00:01:55.097884 - lora key not loaded: transformer.transformer_blocks.7.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.098140 - lora key not loaded: transformer.transformer_blocks.7.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.098399 - lora key not loaded: transformer.transformer_blocks.7.attn.to_q.lora.down.weight
2025-09-30T00:01:55.098663 - lora key not loaded: transformer.transformer_blocks.7.attn.to_q.lora.up.weight
2025-09-30T00:01:55.098933 - lora key not loaded: transformer.transformer_blocks.7.attn.to_v.lora.down.weight
2025-09-30T00:01:55.099245 - lora key not loaded: transformer.transformer_blocks.7.attn.to_v.lora.up.weight
2025-09-30T00:01:55.099531 - lora key not loaded: transformer.transformer_blocks.8.attn.to_k.lora.down.weight
2025-09-30T00:01:55.099844 - lora key not loaded: transformer.transformer_blocks.8.attn.to_k.lora.up.weight
2025-09-30T00:01:55.100110 - lora key not loaded: transformer.transformer_blocks.8.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.100385 - lora key not loaded: transformer.transformer_blocks.8.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.100644 - lora key not loaded: transformer.transformer_blocks.8.attn.to_q.lora.down.weight
2025-09-30T00:01:55.100914 - lora key not loaded: transformer.transformer_blocks.8.attn.to_q.lora.up.weight
2025-09-30T00:01:55.101180 - lora key not loaded: transformer.transformer_blocks.8.attn.to_v.lora.down.weight
2025-09-30T00:01:55.101445 - lora key not loaded: transformer.transformer_blocks.8.attn.to_v.lora.up.weight
2025-09-30T00:01:55.101718 - lora key not loaded: transformer.transformer_blocks.9.attn.to_k.lora.down.weight
2025-09-30T00:01:55.101992 - lora key not loaded: transformer.transformer_blocks.9.attn.to_k.lora.up.weight
2025-09-30T00:01:55.102261 - lora key not loaded: transformer.transformer_blocks.9.attn.to_out.0.lora.down.weight
2025-09-30T00:01:55.102520 - lora key not loaded: transformer.transformer_blocks.9.attn.to_out.0.lora.up.weight
2025-09-30T00:01:55.102806 - lora key not loaded: transformer.transformer_blocks.9.attn.to_q.lora.down.weight
2025-09-30T00:01:55.103075 - lora key not loaded: transformer.transformer_blocks.9.attn.to_q.lora.up.weight
2025-09-30T00:01:55.103342 - lora key not loaded: transformer.transformer_blocks.9.attn.to_v.lora.down.weight
2025-09-30T00:01:55.103595 - lora key not loaded: transformer.transformer_blocks.9.attn.to_v.lora.up.weight
2025-09-30T00:01:55.172853 - Requested to load WAN21
2025-09-30T00:02:04.728205 - loaded completely 15142.240344517088 13626.337951660156 True
2025-09-30T00:02:04.754187 - (RES4LYF) rk_type: res_2s2025-09-30T00:02:04.754455 -
2025-09-30T00:02:04.757797 -
0%| | 0/8 [00:00

Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo"

2025-09-30T00:02:05.048680 - Traceback (most recent call last):
File "D:\ComfyUI\ComfyUI\execution.py", line 496, in execute
output_data, output_ui, has_subgraph, has_pending_tasks = await get_output_data(prompt_id, unique_id, obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, hidden_inputs=hidden_inputs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\ComfyUI\execution.py", line 315, in get_output_data
return_values = await _async_map_node_over_list(prompt_id, unique_id, obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb, hidden_inputs=hidden_inputs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\ComfyUI\execution.py", line 289, in _async_map_node_over_list
await process_inputs(input_dict, i)
File "D:\ComfyUI\ComfyUI\execution.py", line 277, in process_inputs
result = f(**inputs)
File "D:\ComfyUI\ComfyUI\nodes.py", line 1559, in sample
return common_ksampler(model, noise_seed, steps, cfg, sampler_name, scheduler, positive, negative, latent_image, denoise=denoise, disable_noise=disable_noise, start_step=start_at_step, last_step=end_at_step, force_full_denoise=force_full_denoise)
File "D:\ComfyUI\ComfyUI\nodes.py", line 1492, in common_ksampler
samples = comfy.sample.sample(model, noise, steps, cfg, sampler_name, scheduler, positive, negative, latent_image,
denoise=denoise, disable_noise=disable_noise, start_step=start_step, last_step=last_step,
force_full_denoise=force_full_denoise, noise_mask=noise_mask, callback=callback, disable_pbar=disable_pbar, seed=seed)
File "D:\ComfyUI\ComfyUI\comfy\sample.py", line 45, in sample
samples = sampler.sample(noise, positive, negative, cfg=cfg, latent_image=latent_image, start_step=start_step, last_step=last_step, force_full_denoise=force_full_denoise, denoise_mask=noise_mask, sigmas=sigmas, callback=callback, disable_pbar=disable_pbar, seed=seed)
File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 1161, in sample
return sample(self.model, noise, positive, negative, cfg, self.device, sampler, sigmas, self.model_options, latent_image=latent_image, denoise_mask=denoise_mask, callback=callback, disable_pbar=disable_pbar, seed=seed)
File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 1051, in sample
return cfg_guider.sample(noise, latent_image, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)
~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 1036, in sample
output = executor.execute(noise, latent_image, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)
File "D:\ComfyUI\ComfyUI\comfy\patcher_extension.py", line 112, in execute
return self.original(*args, **kwargs)
~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 1004, in outer_sample
output = self.inner_sample(noise, latent_image, device, sampler, sigmas, denoise_mask, callback, disable_pbar, seed)
File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 987, in inner_sample
samples = executor.execute(self, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar)
File "D:\ComfyUI\ComfyUI\comfy\patcher_extension.py", line 112, in execute
return self.original(*args, **kwargs)
~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 759, in sample
samples = self.sampler_function(model_k, noise, sigmas, extra_args=extra_args, callback=k_callback, disable=disable_pbar, **self.extra_options)
File "D:\ComfyUI\ComfyUI\custom_nodes\RES4LYF\beta\__init__.py", line 167, in sample_res_2s
return rk_sampler_beta.sample_rk_beta(model, x, sigmas, None, extra_args, callback, disable, rk_type="res_2s",)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\python_embeded\Lib\site-packages\torch\utils\_contextlib.py", line 120, in decorate_context
return func(*args, **kwargs)
File "D:\ComfyUI\ComfyUI\custom_nodes\RES4LYF\beta\rk_sampler_beta.py", line 1665, in sample_rk_beta
eps_[row], data_[row] = RK(x_tmp, s_tmp, x_0, sigma, transformer_options={'row': row, 'x_tmp': x_tmp, 'sigma_next': sigma_next})
~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\ComfyUI\custom_nodes\RES4LYF\beta\rk_method_beta.py", line 901, in __call__
denoised = self.model_denoised(x.to(self.model_device), sub_sigma.to(self.model_device), **self.extra_args).to(sigma.device)
~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\ComfyUI\custom_nodes\RES4LYF\beta\rk_method_beta.py", line 241, in model_denoised
denoised = self.model(x, sigma * s_in, **extra_args)
File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 408, in __call__
out = self.inner_model(x, sigma, model_options=model_options, seed=seed)
File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 960, in __call__
return self.outer_predict_noise(*args, **kwargs)
~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 967, in outer_predict_noise
).execute(x, timestep, model_options, seed)
~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\ComfyUI\comfy\patcher_extension.py", line 112, in execute
return self.original(*args, **kwargs)
~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 970, in predict_noise
return sampling_function(self.inner_model, x, timestep, self.conds.get("negative", None), self.conds.get("positive", None), self.cfg, model_options=model_options, seed=seed)
File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 388, in sampling_function
out = calc_cond_batch(model, conds, x, timestep, model_options)
File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 206, in calc_cond_batch
return _calc_cond_batch_outer(model, conds, x_in, timestep, model_options)
File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 214, in _calc_cond_batch_outer
return executor.execute(model, conds, x_in, timestep, model_options)
~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\ComfyUI\comfy\patcher_extension.py", line 112, in execute
return self.original(*args, **kwargs)
~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\ComfyUI\comfy\samplers.py", line 333, in _calc_cond_batch
output = model.apply_model(input_x, timestep_, **c).chunk(batch_chunks)
~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\ComfyUI\comfy\model_base.py", line 160, in apply_model
return comfy.patcher_extension.WrapperExecutor.new_class_executor(
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
...<2 lines>...
comfy.patcher_extension.get_all_wrappers(comfy.patcher_extension.WrappersMP.APPLY_MODEL, transformer_options)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
).execute(x, t, c_concat, c_crossattn, control, transformer_options, **kwargs)
~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\ComfyUI\comfy\patcher_extension.py", line 113, in execute
return self.wrappers[self.idx](self, *args, **kwargs)
~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\ComfyUI\comfy_api\torch_helpers\torch_compile.py", line 26, in apply_torch_compile_wrapper
return executor(*args, **kwargs)
File "D:\ComfyUI\ComfyUI\comfy\patcher_extension.py", line 105, in __call__
return new_executor.execute(*args, **kwargs)
~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\ComfyUI\comfy\patcher_extension.py", line 112, in execute
return self.original(*args, **kwargs)
~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\ComfyUI\comfy\model_base.py", line 199, in _apply_model
model_output = self.diffusion_model(xc, t, context=context, control=control, transformer_options=transformer_options, **extra_conds).float()
~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1773, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1784, in _call_impl
return forward_call(*args, **kwargs)
File "D:\ComfyUI\ComfyUI\comfy\ldm\wan\model.py", line 614, in forward
return comfy.patcher_extension.WrapperExecutor.new_class_executor(
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
...<2 lines>...
comfy.patcher_extension.get_all_wrappers(comfy.patcher_extension.WrappersMP.DIFFUSION_MODEL, transformer_options)
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
).execute(x, timestep, context, clip_fea, time_dim_concat, transformer_options, **kwargs)
~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\ComfyUI\comfy\patcher_extension.py", line 112, in execute
return self.original(*args, **kwargs)
~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\ComfyUI\comfy\ldm\wan\model.py", line 634, in _forward
return self.forward_orig(x, timestep, context, clip_fea=clip_fea, freqs=freqs, transformer_options=transformer_options, **kwargs)[:, :, :t, :h, :w]
~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\ComfyUI\comfy\ldm\wan\model.py", line 579, in forward_orig
x = block(x, e=e0, freqs=freqs, context=context, context_img_len=context_img_len, transformer_options=transformer_options)
File "D:\ComfyUI\python_embeded\Lib\site-packages\torch\_dynamo\eval_frame.py", line 375, in __call__
return super().__call__(*args, **kwargs)
~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1773, in _wrapped_call_impl
return self._call_impl(*args, **kwargs)
~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^
File "D:\ComfyUI\python_embeded\Lib\site-packages\torch\nn\modules\module.py", line 1784, in _call_impl
return forward_call(*args, **kwargs)
File "D:\ComfyUI\python_embeded\Lib\site-packages\torch\_dynamo\eval_frame.py", line 745, in compile_wrapper
raise e.with_traceback(None) from e.__cause__ # User compiler error
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
torch._dynamo.exc.Unsupported: torch.* op returned non-Tensor
Explanation: torch.* ops that return a non-Tensor cannot be traced into the Dynamo FX graph output

Developer debug context: example_value type: int; op: call_function; target:

Set TORCHDYNAMO_VERBOSE=1 for the internal stack trace (please do this especially if you're reporting a bug to PyTorch). For even more developer context, set TORCH_LOGS="+dynamo"

2025-09-30T00:02:05.079458 - Prompt executed in 26.38 seconds
2025-09-30T00:02:05.907210 -
0%| | 0/8 [00:01

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Possible Bug with updated pytorch?

Description

Contributor guide

Assessment

Get new issues in your inbox