Nodes and requires_grad=True (pytorch optimization within comfyui)

I have a node that does some pytorch optimization, simple regression over coordinates. When I run this outside of ComfyUI it works fine, inside all the gradient information is missing and so cannot optimize. Is there something in comfyUI that is disabling all the pytorch gradients? For example with something like set_grad_enabled(False)? At any rate, even using that function and setting to True within a context manager does not resolve the problem.