RuntimeError: mat1 and mat2 shapes cannot be multiplied (3456x64 and 128x3072)

### Expected Behavior

I don't know where the problem is, I hope there will be no such error.

### Actual Behavior

When using the workflow of FLUX.1-Canny-dev-lora, sometimes an error is reported, and the image can be produced again after clicking again. It is sometimes good and sometimes bad. It feels like a bug

### Steps to Reproduce


### Debug Logs

```powershell
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "H:\ComfyUI_windows_portable\ComfyUI\comfy\ops.py", line 64, in forward_comfy_cast_weights
return torch.nn.functional.linear(input, weight, bias)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
RuntimeError: mat1 and mat2 shapes cannot be multiplied (3456x64 and 128x3072)
```

### Other

_No response_