torch.AcceleratorError: CUDA error: an illegal memory access was encountered

### Custom Node Testing

- [x] I have tried disabling custom nodes and the issue persists (see [how to disable custom nodes](https://docs.comfy.org/troubleshooting/custom-node-issues#step-1%3A-test-with-all-custom-nodes-disabled) if you need help)

### Expected Behavior

No errors

### Actual Behavior

torch.AcceleratorError: CUDA error: an illegal memory access was encountered

### Steps to Reproduce

It happens when I'm using minimax m3 pruned int8 convrot only when dynamic vram is enabled. With disabled dynamic vram it runs fine

### Debug Logs

```powershell
It happens inside this line
return comfy.ops.linear_input_act(self.fc2, self.fc1(x), "swiglu")
```

### Other

_No response_