Photoshop freezes or CTD's after some generations / comfyUI

I am using a simple img2img workflow with one Controlnet module. Photoshop is running as child process from Lightroom.
After some generations, not many, around 10, Photoshop either just crashes straight to desktop or freezes. Sometimes before it does, the comfyUI nodes becomes unresponsive and does not generate new images even the command is send to the console:

When it freezes it keeps using a lot of CPU power, I got an I9 9900k with up to ~5Ghz on 16 threads, 20% is a lot in that context:

I have updated Photoshop and it keeps crashing using the plugin. I have tried to trace an error but the logs of PS and win event log does not give any hint or meaningfull error code, other than the log that it crashed.
When not using the plugin and doing basic PS stuff, PS is actually stable.

Also, I post this here because I had crashes using SD aswell, but it has been a while. So I doubt this is specifically related to using comfyUI.