BUG： control Net and layerdiffuse via API calls!!!

Nobody has claimed this yet.

WARNING:root:Sampler Scheduler autocorrection: "Euler" -> "Euler", "None" -> "Automatic"
2024-07-30 11:18:13,767 - ControlNet - INFO - ControlNet Input Mode: InputMode.SIMPLE
*** Error running process: /data1/SD/stable-diffusion-webui/extensions-builtin/sd_forge_controlnet/scripts/controlnet.py
Traceback (most recent call last):
File "/data1/SD/stable-diffusion-webui/modules/scripts.py", line 844, in process
script.process(p, *script_args)
File "/home/layabox01/anaconda3/envs/sam/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "/data1/SD/stable-diffusion-webui/extensions-builtin/sd_forge_controlnet/scripts/controlnet.py", line 554, in process
self.process_unit_after_click_generate(p, unit, params, *args, **kwargs)
File "/home/layabox01/anaconda3/envs/sam/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "/data1/SD/stable-diffusion-webui/extensions-builtin/sd_forge_controlnet/scripts/controlnet.py", line 304, in process_unit_after_click_generate
input_list, resize_mode = self.get_input_data(p, unit, preprocessor, h, w)
File "/data1/SD/stable-diffusion-webui/extensions-builtin/sd_forge_controlnet/scripts/controlnet.py", line 205, in get_input_data
resize_mode = external_code.resize_mode_from_value(p.resize_mode)
AttributeError: 'StableDiffusionProcessingTxt2Img' object has no attribute 'resize_mode'

---
[LORA] Loaded /data1/SD/stable-diffusion-webui/models/Lora/2D Pixel Toolkit (2D像素工具包)_角色和序列帧.safetensors for BaseModel-UNet with 192 keys at weight 0.6 (skipped 0 keys)
[LORA] Loaded /data1/SD/stable-diffusion-webui/models/Lora/2D Pixel Toolkit (2D像素工具包)_角色和序列帧.safetensors for BaseModel-CLIP with 72 keys at weight 0.6 (skipped 0 keys)
To load target model SD1ClipModel
Begin to load 1 model
Reuse 1 loaded models
[Memory Management] Current Free GPU Memory (MB) = 22790.29833984375
[Memory Management] Model Memory (MB) = 0.0
[Memory Management] Minimal Inference Memory (MB) = 1024.0
[Memory Management] Estimated Remaining GPU Memory (MB) = 21766.29833984375
Moving model(s) has taken 0.15 seconds
*** Error running process_before_every_sampling: /data1/SD/stable-diffusion-webui/extensions-builtin/sd_forge_controlnet/scripts/controlnet.py
Traceback (most recent call last):
File "/data1/SD/stable-diffusion-webui/modules/scripts.py", line 892, in process_before_every_sampling
script.process_before_every_sampling(p, *script_args, **kwargs)
File "/home/layabox01/anaconda3/envs/sam/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "/data1/SD/stable-diffusion-webui/extensions-builtin/sd_forge_controlnet/scripts/controlnet.py", line 561, in process_before_every_sampling
self.process_unit_before_every_sampling(p, unit, self.current_params[i], *args, **kwargs)
KeyError: 0

---
[LayerDiffuse] LayerMethod.FG_ONLY_ATTN
*** Error running process_before_every_sampling: /data1/SD/stable-diffusion-webui/extensions/sd-forge-layerdiffuse/scripts/forge_layerdiffusion.py
Traceback (most recent call last):
File "/data1/SD/stable-diffusion-webui/modules/scripts.py", line 892, in process_before_every_sampling
script.process_before_every_sampling(p, *script_args, **kwargs)
File "/data1/SD/stable-diffusion-webui/extensions/sd-forge-layerdiffuse/scripts/forge_layerdiffusion.py", line 199, in process_before_every_sampling
fg_additional_prompt = fg_additional_prompt + ', ' + original_prompt if fg_additional_prompt != '' else None
TypeError: unsupported operand type(s) for +: 'NoneType' and 'str'

---
To load target model BaseModel
Begin to load 1 model
[Memory Management] Current Free GPU Memory (MB) = 22771.47265625
[Memory Management] Model Memory (MB) = 1639.4137649536133
[Memory Management] Minimal Inference Memory (MB) = 1024.0
[Memory Management] Estimated Remaining GPU Memory (MB) = 20108.058891296387
Moving model(s) has taken 0.86 seconds
100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 20/20 [00:05<00:00, 3.86it/s]
To load target model AutoencoderKL██████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 20/20 [00:04<00:00, 3.97it/s]
Begin to load 1 model
[Memory Management] Current Free GPU Memory (MB) = 21099.41552734375
[Memory Management] Model Memory (MB) = 159.55708122253418
[Memory Management] Minimal Inference Memory (MB) = 1024.0
[Memory Management] Estimated Remaining GPU Memory (MB) = 19915.858446121216
Moving model(s) has taken 0.25 seconds
*** Error running postprocess_batch_list: /data1/SD/stable-diffusion-webui/extensions-builtin/sd_forge_controlnet/scripts/controlnet.py
Traceback (most recent call last):
File "/data1/SD/stable-diffusion-webui/modules/scripts.py", line 916, in postprocess_batch_list
script.postprocess_batch_list(p, pp, *script_args, **kwargs)
File "/home/layabox01/anaconda3/envs/sam/lib/python3.10/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "/data1/SD/stable-diffusion-webui/extensions-builtin/sd_forge_controlnet/scripts/controlnet.py", line 567, in postprocess_batch_list
self.process_unit_after_every_sampling(p, unit, self.current_params[i], pp, *args, **kwargs)
KeyError: 0

---
To load target model UNet1024
Begin to load 1 model
[Memory Management] Current Free GPU Memory (MB) = 20931.2373046875
[Memory Management] Model Memory (MB) = 198.56415557861328
[Memory Management] Minimal Inference Memory (MB) = 1024.0
[Memory Management] Estimated Remaining GPU Memory (MB) = 19708.673149108887
Moving model(s) has taken 0.08 seconds
100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 8/8 [00:01<00:00, 5.82it/s]
Total progress: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 20/20 [00:07<00:00, 2.59it/s]
INFO: 111.198.61.223:34374 - "POST /sdapi/v1/txt2img HTTP/1.1" 200 OK███████████████████████████████████████████████████████████████████████████████████████████████████████████| 20/20 [00:07<00:00, 3.97it/s]

POST:
payload = {
"prompt":"boy,[pixel]",
"sd_model_checkpoint": "AWPainting_v1.2.safetensors [3d1b3c42ec]",
'negative_prompt': 'bad-artist-anime bad-artist bad-hands-5 bad_prompt bad_prompt_version2 easynegative ng_deepnegative_v1_75t kbxll (worst quality, low quality:1.3)',
'sd_vae': 'anything-v4.0.vae',
"CLIP_stop_at_last_layers": 1,
'width': 1024,
'height': 1024,
'denoising_strength': 0.5,
'enable_hr': False,
'hr_upscaler': 'ESRGAN_4x',
'hr_scale': '2.0',
'sampler': 'Euler a',
'steps': 20,
'cfg_scale': 8.5,
"init_images": [imgae2base64("./image.png")],
"alwayson_scripts": {
"ControlNet": {
"args": [
{

"control_mode": "Balanced",
"guidance_end": 1,
"guidance_start": 0,
"pixel_perfect": True,
"processor_res": 512,
"image": imgae2base64("./image.png"),
"mask_image":imgae2base64("./image.png"),
"enabled": True,
"module":'None',
"model": "control_v11p_sd15_openpose [cab727d4]",
"threshold_a": 64,
"threshold_b": 64,
"weight": 1,
"save_detected_map": True,
"hr_option": "Both",
},

]
},
"LayerDiffuse": {
"args": [
{
"layerdiffusion_enabled":True,
"layerdiffusion_method":"(SD1.5) Only Generate Transparent Image (Attention Injection)",
"layerdiffusion_weight": 1,
"layerdiffusion_ending_step":1,
"layerdiffusion_fg_image": "",
"layerdiffusion_bg_image":"",
"layerdiffusion_blend_image":"",
"layerdiffusion_resize_mode":"Crop and Resize",
"layerdiffusion_fg_additional_prompt":"",
"layerdiffusion_bg_additional_prompt":"",
"layerdiffusion_blend_additional_prompt":""
}
]

}
}
}
I think there is a problem with control net, since the preprocessor chose None, why do you need mask images?

Reproduce the POST /sdapi/v1/txt2img request using the supplied ControlNet and LayerDiffuse payload. Start with extensions-builtin/sd_forge_controlnet/scripts/controlnet.py at lines 205, 304, 554, 561, and 567, then inspect extensions/sd-forge-layerdiffuse/scripts/forge_layerdiffusion.py at line 199. Done means the request no longer raises these reported exceptions and the failing integration behavior is covered or clearly explained.

Written by the indexing model from the issue text.