lllyasviel / lllyasviel/stable-diffusion-webui-forge
Flux's controlnet is not working
- Dominant language
- Python
- Stars
- 13k
- Forks
- 1.7k
- PR merge metrics
- No merged PRs in 30d
Description
I downloaded the model of flux's controlnet from this address (https://huggingface.co/XLabs-AI/flux-controlnet-collections/tree/main),When I use it in the forge UI, the background prompts me
2024-08-15 13:40:35,555 - ControlNet - ERROR - Recognizing Control Model failed: E:\SD\sdwebui\extensions\sd-webui-controlnet\models\flux-canny-controlnet_v2.safetensors
*** Error running process: D:\webui_forge_cu124_torch24\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
Traceback (most recent call last):
File "D:\webui_forge_cu124_torch24\webui\modules\scripts.py", line 844, in process
script.process(p, *script_args)
File "D:\webui_forge_cu124_torch24\system\python\lib\site-packages\torch\utils\_contextlib.py", line 116, in decorate_context
return func(*args, **kwargs)
File "D:\webui_forge_cu124_torch24\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 554, in process
self.process_unit_after_click_generate(p, unit, params, *args, **kwargs)
File "D:\webui_forge_cu124_torch24\system\python\lib\site-packages\torch\utils\_contextlib.py", line 116, in decorate_context
return func(*args, **kwargs)
File "D:\webui_forge_cu124_torch24\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 414, in process_unit_after_click_generate
assert params.model is not None, logger.error(f"Recognizing Control Model failed: {model_filename}")
AssertionError: None
*** Error running process_before_every_sampling: D:\webui_forge_cu124_torch24\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
Traceback (most recent call last):
File "D:\webui_forge_cu124_torch24\webui\modules\scripts.py", line 892, in process_before_every_sampling
script.process_before_every_sampling(p, *script_args, **kwargs)
File "D:\webui_forge_cu124_torch24\system\python\lib\site-packages\torch\utils\_contextlib.py", line 116, in decorate_context
return func(*args, **kwargs)
File "D:\webui_forge_cu124_torch24\webui\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 561, in process_before_every_sampling
self.process_unit_before_every_sampling(p, unit, self.current_params[i], *args, **kwargs)
KeyError: 0
Hope to fix it soon
Contributor guide
No contributing guide indexed for this repository
Research direction
Reproduce the failure with the referenced Flux ControlNet model, then start in extensions-builtin/sd_forge_controlnet/scripts/controlnet.py at process_unit_after_click_generate and process_before_every_sampling. Trace why model recognition returns None and why current_params lacks key 0. Done means the model is recognized and generation completes without the reported AssertionError or KeyError.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- ai, machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100