Very slow Control LoRA

Hi guys! I couldn’t find a similar problem, so I decided to create a separate topic.

I tried 3 different workflows for using the new Control LoRA with SDXL and in all cases the generation speed is incredibly low (about 30 minutes for one image). At the same time, SDXL itself works great, generating two 1024x1024 images in 29 seconds.
What could be the problem?

Graphics card: 2060s 8gb
ComfyUI (Nightly)
Args: --windows-standalone-build --use-pytorch-cross-attention --disable-xformers
(I tried with Xformers as well)
https://huggingface.co/stabilityai/control-lora/tree/main