Model merge broken | clip encode errors | Multi lora errors | much more

ComfyUI is completely broken, All my workflow with model merge multi lora, average conditioning is giving lots of errors, and warning, Noised image k-sampler generation.
In this image the first generation was done correctly after this first one all the other give this noised, distorted image, and I get a lot of warning that don't show before.

First generation image and the generating noised image.


Errors and warning:
WARNING SHAPE MISMATCH diffusion_model.output_blocks.5.1.transformer_blocks.0.ff.net.2.weight WEIGHT NOT MERGED torch.Size([640, 2560]) != torch.Size([640])
WARNING SHAPE MISMATCH diffusion_model.output_blocks.5.1.transformer_blocks.0.ff.net.2.weight WEIGHT NOT MERGED torch.Size([640, 2560]) != torch.Size([640])
ERROR lora diffusion_model.output_blocks.5.1.transformer_blocks.0.ff.net.2.weight shape '[640]' is invalid for input of size 1638400
WARNING SHAPE MISMATCH diffusion_model.output_blocks.5.1.transformer_blocks.1.attn1.to_out.0.weight WEIGHT NOT MERGED torch.Size([640, 640]) != torch.Size([640])
WARNING SHAPE MISMATCH diffusion_model.output_blocks.5.1.transformer_blocks.1.attn1.to_out.0.weight WEIGHT NOT MERGED torch.Size([640, 640]) != torch.Size([640])
ERROR lora diffusion_model.output_blocks.5.1.transformer_blocks.1.attn1.to_out.0.weight shape '[640]' is invalid for input of size 409600
WARNING SHAPE MISMATCH diffusion_model.output_blocks.5.1.transformer_blocks.1.attn2.to_out.0.weight WEIGHT NOT MERGED torch.Size([640, 640]) != torch.Size([640])
WARNING SHAPE MISMATCH diffusion_model.output_blocks.5.1.transformer_blocks.1.attn2.to_out.0.weight WEIGHT NOT MERGED torch.Size([640, 640]) != torch.Size([640])
ERROR lora diffusion_model.output_blocks.5.1.transformer_blocks.1.attn2.to_out.0.weight shape '[640]' is invalid for input of size 409600
WARNING SHAPE MISMATCH diffusion_model.output_blocks.5.1.transformer_blocks.1.ff.net.0.proj.weight WEIGHT NOT MERGED torch.Size([5120, 640]) != torch.Size([5120])
WARNING SHAPE MISMATCH diffusion_model.output_blocks.5.1.transformer_blocks.1.ff.net.0.proj.weight WEIGHT NOT MERGED torch.Size([5120, 640]) != torch.Size([5120])
ERROR lora diffusion_model.output_blocks.5.1.transformer_blocks.1.ff.net.0.proj.weight shape '[5120]' is invalid for input of size 3276800
WARNING SHAPE MISMATCH diffusion_model.output_blocks.5.1.transformer_blocks.1.ff.net.2.weight WEIGHT NOT MERGED torch.Size([640, 2560]) != torch.Size([640])
WARNING SHAPE MISMATCH diffusion_model.output_blocks.5.1.transformer_blocks.1.ff.net.2.weight WEIGHT NOT MERGED torch.Size([640, 2560]) != torch.Size([640])
ERROR lora diffusion_model.output_blocks.5.1.transformer_blocks.1.ff.net.2.weight shape '[640]' is invalid for input of size 1638400
WARNING SHAPE MISMATCH diffusion_model.output_blocks.5.1.proj_out.weight WEIGHT NOT MERGED torch.Size([640, 640]) != torch.Size([640])
WARNING SHAPE MISMATCH diffusion_model.output_blocks.5.1.proj_out.weight WEIGHT NOT MERGED torch.Size([640, 640]) != torch.Size([640])
ERROR lora diffusion_model.output_blocks.5.1.proj_out.weight shape '[640]' is invalid for input of size 409600
WARNING SHAPE MISMATCH diffusion_model.output_blocks.5.2.conv.weight WEIGHT NOT MERGED torch.Size([640, 640, 3, 3]) != torch.Size([640])
WARNING SHAPE MISMATCH diffusion_model.output_blocks.5.2.conv.weight WEIGHT NOT MERGED torch.Size([640, 640, 3, 3]) != torch.Size([640])
ERROR lora diffusion_model.output_blocks.5.2.conv.weight shape '[640]' is invalid for input of size 3686400
WARNING SHAPE MISMATCH diffusion_model.output_blocks.6.0.in_layers.2.weight WEIGHT NOT MERGED torch.Size([320, 960, 3, 3]) != torch.Size([320])
WARNING SHAPE MISMATCH diffusion_model.output_blocks.6.0.in_layers.2.weight WEIGHT NOT MERGED torch.Size([320, 960, 3, 3]) != torch.Size([320])
ERROR lora diffusion_model.output_blocks.6.0.in_layers.2.weight shape '[320]' is invalid for input of size 2764800
WARNING SHAPE MISMATCH diffusion_model.output_blocks.6.0.emb_layers.1.weight WEIGHT NOT MERGED torch.Size([320, 1280]) != torch.Size([320])
WARNING SHAPE MISMATCH diffusion_model.output_blocks.6.0.emb_layers.1.weight WEIGHT NOT MERGED torch.Size([320, 1280]) != torch.Size([320])
ERROR lora diffusion_model.output_blocks.6.0.emb_layers.1.weight shape '[320]' is invalid for input of size 409600
WARNING SHAPE MISMATCH diffusion_model.output_blocks.6.0.out_layers.3.weight WEIGHT NOT MERGED torch.Size([320, 320, 3, 3]) != torch.Size([320])
WARNING SHAPE MISMATCH diffusion_model.output_blocks.6.0.out_layers.3.weight WEIGHT NOT MERGED torch.Size([320, 320, 3, 3]) != torch.Size([320])
ERROR lora diffusion_model.output_blocks.6.0.out_layers.3.weight shape '[320]' is invalid for input of size 921600
WARNING SHAPE MISMATCH diffusion_model.output_blocks.6.0.skip_connection.weight WEIGHT NOT MERGED torch.Size([320, 960, 1, 1]) != torch.Size([320])
WARNING SHAPE MISMATCH diffusion_model.output_blocks.6.0.skip_connection.weight WEIGHT NOT MERGED torch.Size([320, 960, 1, 1]) != torch.Size([320])
ERROR lora diffusion_model.output_blocks.6.0.skip_connection.weight shape '[320]' is invalid for input of size 307200
WARNING SHAPE MISMATCH diffusion_model.output_blocks.7.0.in_layers.2.weight WEIGHT NOT MERGED torch.Size([320, 640, 3, 3]) != torch.Size([320])
WARNING SHAPE MISMATCH diffusion_model.output_blocks.7.0.in_layers.2.weight WEIGHT NOT MERGED torch.Size([320, 640, 3, 3]) != torch.Size([320])
ERROR lora diffusion_model.output_blocks.7.0.in_layers.2.weight shape '[320]' is invalid for input of size 1843200
WARNING SHAPE MISMATCH diffusion_model.output_blocks.7.0.emb_layers.1.weight WEIGHT NOT MERGED torch.Size([320, 1280]) != torch.Size([320])
WARNING SHAPE MISMATCH diffusion_model.output_blocks.7.0.emb_layers.1.weight WEIGHT NOT MERGED torch.Size([320, 1280]) != torch.Size([320])
ERROR lora diffusion_model.output_blocks.7.0.emb_layers.1.weight shape '[320]' is invalid for input of size 409600
WARNING SHAPE MISMATCH diffusion_model.output_blocks.7.0.out_layers.3.weight WEIGHT NOT MERGED torch.Size([320, 320, 3, 3]) != torch.Size([320])
WARNING SHAPE MISMATCH diffusion_model.output_blocks.7.0.out_layers.3.weight WEIGHT NOT MERGED torch.Size([320, 320, 3, 3]) != torch.Size([320])
ERROR lora diffusion_model.output_blocks.7.0.out_layers.3.weight shape '[320]' is invalid for input of size 921600
WARNING SHAPE MISMATCH diffusion_model.output_blocks.7.0.skip_connection.weight WEIGHT NOT MERGED torch.Size([320, 640, 1, 1]) != torch.Size([320])
WARNING SHAPE MISMATCH diffusion_model.output_blocks.7.0.skip_connection.weight WEIGHT NOT MERGED torch.Size([320, 640, 1, 1]) != torch.Size([320])
ERROR lora diffusion_model.output_blocks.7.0.skip_connection.weight shape '[320]' is invalid for input of size 204800
WARNING SHAPE MISMATCH diffusion_model.output_blocks.8.0.in_layers.2.weight WEIGHT NOT MERGED torch.Size([320, 640, 3, 3]) != torch.Size([320])
WARNING SHAPE MISMATCH diffusion_model.output_blocks.8.0.in_layers.2.weight WEIGHT NOT MERGED torch.Size([320, 640, 3, 3]) != torch.Size([320])
ERROR lora diffusion_model.output_blocks.8.0.in_layers.2.weight shape '[320]' is invalid for input of size 1843200
WARNING SHAPE MISMATCH diffusion_model.output_blocks.8.0.emb_layers.1.weight WEIGHT NOT MERGED torch.Size([320, 1280]) != torch.Size([320])
WARNING SHAPE MISMATCH diffusion_model.output_blocks.8.0.emb_layers.1.weight WEIGHT NOT MERGED torch.Size([320, 1280]) != torch.Size([320])
ERROR lora diffusion_model.output_blocks.8.0.emb_layers.1.weight shape '[320]' is invalid for input of size 409600
WARNING SHAPE MISMATCH diffusion_model.output_blocks.8.0.out_layers.3.weight WEIGHT NOT MERGED torch.Size([320, 320, 3, 3]) != torch.Size([320])
WARNING SHAPE MISMATCH diffusion_model.output_blocks.8.0.out_layers.3.weight WEIGHT NOT MERGED torch.Size([320, 320, 3, 3]) != torch.Size([320])
ERROR lora diffusion_model.output_blocks.8.0.out_layers.3.weight shape '[320]' is invalid for input of size 921600
WARNING SHAPE MISMATCH diffusion_model.output_blocks.8.0.skip_connection.weight WEIGHT NOT MERGED torch.Size([320, 640, 1, 1]) != torch.Size([320])
WARNING SHAPE MISMATCH diffusion_model.output_blocks.8.0.skip_connection.weight WEIGHT NOT MERGED torch.Size([320, 640, 1, 1]) != torch.Size([320])
ERROR lora diffusion_model.output_blocks.8.0.skip_connection.weight shape '[320]' is invalid for input of size 204800
WARNING SHAPE MISMATCH diffusion_model.out.2.weight WEIGHT NOT MERGED torch.Size([4, 320, 3, 3]) != torch.Size([4])
WARNING SHAPE MISMATCH diffusion_model.out.2.weight WEIGHT NOT MERGED torch.Size([4, 320, 3, 3]) != torch.Size([4])
38%|███████████████████████████████▌ | 3/8 [00:52<01:28, 17.66s/it]
Processing interrupted
Prompt executed in 62.01 seconds