Inpaint not working on SDXL using sdxl_gen_img.py

When I try to generate images using:
"python sdxl_gen_img.py --outdir "outputs" --ckpt stabilityai/stable-diffusion-xl-base-1.0 --steps 40 --strength 0.8 --prompt "A picture of a chair" --network_module networks.lora --network_weights test_output/test_output-step00001500.safetensors --image_path "inpaint-images/input/input0.jpeg" --mask_path "inpaint-images/input/input0-mask.jpg""
My images get weirdly distorted all over. --fp16 returns black images, but that apparently has something to do with the VAE. using --bf16 or the standard float32 as above, does not resolve the issue. I will add the mask and the init_image below, as well as the generated image.


Start by reproducing the exact command through sdxl_gen_img.py with the attached input image and mask, then inspect the SDXL inpainting path and its precision/VAE handling. Done means the masked image no longer becomes distorted and the reported fp16 behavior is understood or corrected.

Written by the indexing model from the issue text.