lllyasviel / lllyasviel/stable-diffusion-webui-forge

Flux's controlnet is not working

Open
#1,127 18 comments 9 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
13k
Forks
1.7k
PR merge metrics
No merged PRs in 30d

Description

I downloaded the model of flux's controlnet from this address (https://huggingface.co/XLabs-AI/flux-controlnet-collections/tree/main),When I use it in the forge UI, the background prompts me
2024-08-15 13:40:35,555 - ControlNet - ERROR - Recognizing Control Model failed: E:\SD\sdwebui\extensions\sd-webui-controlnet\models\flux-canny-controlnet_v2.safetensors
*** Error running process: D:\webui_forge_cu124_torch24\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
Traceback (most recent call last):
File "D:\webui_forge_cu124_torch24\webui\modules\scripts.py", line 844, in process
script.process(p, *script_args)
File "D:\webui_forge_cu124_torch24\system\python\lib\site-packages\torch\utils\_contextlib.py", line 116, in decorate_context
return func(*args, **kwargs)
File "D:\webui_forge_cu124_torch24\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 554, in process
self.process_unit_after_click_generate(p, unit, params, *args, **kwargs)
File "D:\webui_forge_cu124_torch24\system\python\lib\site-packages\torch\utils\_contextlib.py", line 116, in decorate_context
return func(*args, **kwargs)
File "D:\webui_forge_cu124_torch24\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 414, in process_unit_after_click_generate
assert params.model is not None, logger.error(f"Recognizing Control Model failed: {model_filename}")
AssertionError: None

*** Error running process_before_every_sampling: D:\webui_forge_cu124_torch24\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
Traceback (most recent call last):
File "D:\webui_forge_cu124_torch24\webui\modules\scripts.py", line 892, in process_before_every_sampling
script.process_before_every_sampling(p, *script_args, **kwargs)
File "D:\webui_forge_cu124_torch24\system\python\lib\site-packages\torch\utils\_contextlib.py", line 116, in decorate_context
return func(*args, **kwargs)
File "D:\webui_forge_cu124_torch24\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 561, in process_before_every_sampling
self.process_unit_before_every_sampling(p, unit, self.current_params[i], *args, **kwargs)
KeyError: 0

Hope to fix it soon

Contributor guide

No contributing guide indexed for this repository

Research direction

Reproduce the failure with the referenced Flux ControlNet model, then start in extensions-builtin/sd_forge_controlnet/scripts/controlnet.py at process_unit_after_click_generate and process_before_every_sampling. Trace why model recognition returns None and why current_params lacks key 0. Done means the model is recognized and generation completes without the reported AssertionError or KeyError.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
ai, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.