lllyasviel / lllyasviel/stable-diffusion-webui-forge

[Bug]: /controlnet/module_list returns partial results

Open
#668 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
13k
Forks
1.7k
PR merge metrics
No merged PRs in 30d

Description

### Checklist

- [ ] The issue exists after disabling all extensions
- [X] The issue exists on a clean installation of webui
- [X] The issue is caused by an extension, but I believe it is caused by a bug in the webui
- [X] The issue exists in the current version of the webui
- [X] The issue has not been reported before recently
- [ ] The issue has been reported before but has not been fixed yet

### What happened?

This is a backwards compatibility bug with the A1111 WebUI version of ControlNet.

/controlnet/module_list

On A1111, you get a response that's structured like this, with a `module_list` and `module_detail`:

```
{
"module_list": [
"none",
"canny",
...
],
"module_detail": {
"none": {
"model_free": false,
"sliders": []
},
"canny": {
"model_free": false,
"sliders": [
{
"name": "Preprocessor Resolution",
"value": 512,
"min": 64,
"max": 2048
},
{
"name": "Canny Low Threshold",
"value": 100,
"min": 1,
"max": 255
},
{
"name": "Canny High Threshold",
"value": 200,
"min": 1,
"max": 255
}
]
},
...
}
```

In Forge, the `module_detail` part is completely missing.

This omission of the preprocessor slider info means that for 3rd party apps that use ControlNet (like plugins for drawing programs) users can't control the preprocessor, they're stuck with the default values.

### Steps to reproduce the problem

1. GET /controlnet/module_list in A1111
2. Note the `module_detail`
3. GET /controlnet/module_list in Forge
4. Note the `modeule_detail` section is missing

### What should have happened?

`module_detail` should be returned, mirroring the API response of A1111 WebUI

### What browsers do you use to access the UI ?

_No response_

### Sysinfo

{
"Platform": "Windows-10-10.0.19045-SP0",
"Python": "3.10.6",
"Version": "f0.0.17v1.8.0rc-latest-276-g29be1da7",
"Commit": "29be1da7cf2b5dccfc70fbdd33eb35c56a31ffb7",
"Script path": "D:\\Documents\\AI\\ImgGen\\Forge\\webui",
"Data path": "D:\\Documents\\AI\\ImgGen\\Forge\\webui",
"Extensions dir": "D:\\Documents\\AI\\ImgGen\\Forge\\webui\\extensions",
"Checksum": "7b4921e8ef890a00bce26df030eb694b9c95e6d3fb42e46cc492ba40b0a7db49",
"Commandline": [
"launch.py",
"--api",
"--listen",
"--port",
"7865",
"--ckpt-dir",
"D:\\Documents\\AI\\ImgGen\\stable-diffusion-webui/models/Stable-diffusion",
"--hypernetwork-dir",
"D:\\Documents\\AI\\ImgGen\\stable-diffusion-webui/models/hypernetworks",
"--embeddings-dir",
"D:\\Documents\\AI\\ImgGen\\stable-diffusion-webui/embeddings",
"--lora-dir",
"D:\\Documents\\AI\\ImgGen\\stable-diffusion-webui/models/Lora"
],
"Torch env info": {
"torch_version": "2.2.0+cu121",
"is_debug_build": "False",
"cuda_compiled_version": "12.1",
"gcc_version": null,
"clang_version": null,
"cmake_version": null,
"os": "Microsoft Windows 10 Pro",
"libc_version": "N/A",
"python_version": "3.10.6 (tags/v3.10.6:9c7b4bd, Aug 1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)] (64-bit runtime)",
"python_platform": "Windows-10-10.0.19045-SP0",
"is_cuda_available": "True",
"cuda_runtime_version": null,
"cuda_module_loading": "LAZY",
"nvidia_driver_version": "551.61",
"nvidia_gpu_models": "GPU 0: NVIDIA GeForce RTX 3070",
"cudnn_version": null,
"pip_version": "pip3",
"pip_packages": [
"numpy==1.26.2",
"onnx==1.14.0",
"onnxruntime==1.15.0",
"open-clip-torch==2.20.0",
"pytorch-lightning==1.9.4",
"torch==2.2.0+cu121",
"torchaudio==2.2.0+cu121",
"torchdiffeq==0.2.3",
"torchmcubes==0.1.0",
"torchmetrics==1.3.2",
"torchsde==0.2.6",
"torchvision==0.17.0+cu121"
],
"conda_packages": null,
"hip_compiled_version": "N/A",
"hip_runtime_version": "N/A",
"miopen_runtime_version": "N/A",
"caching_allocator_config": "",
"is_xnnpack_available": "True",
"cpu_info": [
"Architecture=9",
"CurrentClockSpeed=4501",
"DeviceID=CPU0",
"Family=107",
"L2CacheSize=8192",
"L2CacheSpeed=",
"Manufacturer=AuthenticAMD",
"MaxClockSpeed=4501",
"Name=AMD Ryzen 7 7700X 8-Core Processor ",
"ProcessorType=3",
"Revision=24834"
]
},
"Exceptions": [],
"CPU": {
"model": "AMD64 Family 25 Model 97 Stepping 2, AuthenticAMD",
"count logical": 16,
"count physical": 8
},
"RAM": {
"total": "31GB",
"used": "19GB",
"free": "12GB"
},
"Extensions": [
{
"name": "sd-webui-api-payload-display",
"path": "D:\\Documents\\AI\\ImgGen\\Forge\\webui\\extensions\\sd-webui-api-payload-display",
"version": "2d3332d9",
"branch": "main",
"remote": "https://github.com/huchenlei/sd-webui-api-payload-display.git"
}
],
"Inactive extensions": [],
"Environment": {
"COMMANDLINE_ARGS": "--api --listen --port 7865 --ckpt-dir \"D:\\Documents\\AI\\ImgGen\\stable-diffusion-webui\"/models/Stable-diffusion --hypernetwork-dir \"D:\\Documents\\AI\\ImgGen\\stable-diffusion-webui\"/models/hypernetworks --embeddings-dir \"D:\\Documents\\AI\\ImgGen\\stable-diffusion-webui\"/embeddings --lora-dir \"D:\\Documents\\AI\\ImgGen\\stable-diffusion-webui\"/models/Lora",
"GRADIO_ANALYTICS_ENABLED": "False"
},
"Config": {
"ldsr_steps": 100,
"ldsr_cached": false,
"SCUNET_tile": 256,
"SCUNET_tile_overlap": 8,
"SWIN_tile": 192,
"SWIN_tile_overlap": 8,
"SWIN_torch_compile": false,
"control_net_detectedmap_dir": "detected_maps",
"control_net_models_path": "",
"control_net_modules_path": "",
"control_net_unit_count": 3,
"control_net_model_cache_size": 5,
"control_net_no_detectmap": false,
"control_net_detectmap_autosaving": false,
"control_net_allow_script_control": false,
"control_net_sync_field_args": true,
"controlnet_show_batch_images_in_ui": false,
"controlnet_increment_seed_during_batch": false,
"controlnet_disable_openpose_edit": false,
"controlnet_disable_photopea_edit": false,
"controlnet_photopea_warning": true,
"controlnet_input_thumbnail": true,
"sd_checkpoint_hash": "d48c2391e04f7dbc83d8538b71be8a30991f3e4e2ff1a8a757b849381f769a8b",
"sd_model_checkpoint": "aamXLAnimeMix_v10.safetensors",
"outdir_samples": "",
"outdir_txt2img_samples": "output\\txt2img-images",
"outdir_img2img_samples": "output\\img2img-images",
"outdir_extras_samples": "output\\extras-images",
"outdir_grids": "",
"outdir_txt2img_grids": "output\\txt2img-grids",
"outdir_img2img_grids": "output\\img2img-grids",
"outdir_save": "log\\images",
"outdir_init_images": "output\\init-images",
"samples_save": true,
"samples_format": "png",
"samples_filename_pattern": "",
"save_images_add_number": true,
"save_images_replace_action": "Replace",
"grid_save": true,
"grid_format": "png",
"grid_extended_filename": false,
"grid_only_if_multiple": true,
"grid_prevent_empty_spots": false,
"grid_zip_filename_pattern": "",
"n_rows": -1,
"font": "",
"grid_text_active_color": "#000000",
"grid_text_inactive_color": "#999999",
"grid_background_color": "#ffffff",
"save_images_before_face_restoration": false,
"save_images_before_highres_fix": false,
"save_images_before_color_correction": false,
"save_mask": false,
"save_mask_composite": false,
"jpeg_quality": 80,
"webp_lossless": false,
"export_for_4chan": true,
"img_downscale_threshold": 4.0,
"target_side_length": 4000.0,
"img_max_size_mp": 200.0,
"use_original_name_batch": true,
"use_upscaler_name_as_suffix": false,
"save_selected_only": true,
"save_init_img": false,
"temp_dir": "",
"clean_temp_dir_at_start": false,
"save_incomplete_images": false,
"notification_audio": true,
"notification_volume": 100,
"save_to_dirs": true,
"grid_save_to_dirs": true,
"use_save_to_dirs_for_ui": false,
"directories_filename_pattern": "[date]",
"directories_max_prompt_words": 8,
"auto_backcompat": true,
"use_old_emphasis_implementation": false,
"use_old_karras_scheduler_sigmas": false,
"no_dpmpp_sde_batch_determinism": false,
"use_old_hires_fix_width_height": false,
"dont_fix_second_order_samplers_schedule": false,
"hires_fix_use_firstpass_conds": false,
"use_old_scheduling": false,
"use_downcasted_alpha_bar": false,
"lora_functional": false,
"extra_networks_show_hidden_directories": true,
"extra_networks_dir_button_function": false,
"extra_networks_hidden_models": "When searched",
"extra_networks_default_multiplier": 1,
"extra_networks_card_width": 0.0,
"extra_networks_card_height": 0.0,
"extra_networks_card_text_scale": 1,
"extra_networks_card_show_desc": true,
"extra_networks_card_order_field": "Path",
"extra_networks_card_order": "Ascending",
"extra_networks_tree_view_default_enabled": false,
"extra_networks_add_text_separator": " ",
"ui_extra_networks_tab_reorder": "",
"textual_inversion_print_at_load": false,
"textual_inversion_add_hashes_to_infotext": true,
"sd_hypernetwork": "None",
"sd_lora": "None",
"lora_preferred_name": "Alias from file",
"lora_add_hashes_to_infotext": true,
"lora_show_all": false,
"lora_hide_unknown_for_versions": [],
"lora_in_memory_limit": 0,
"lora_not_found_warning_console": false,
"lora_not_found_gradio_warning": false,
"cross_attention_optimization": "Automatic",
"s_min_uncond": 0,
"token_merging_ratio": 0,
"token_merging_ratio_img2img": 0,
"token_merging_ratio_hr": 0,
"pad_cond_uncond": false,
"pad_cond_uncond_v0": false,
"persistent_cond_cache": true,
"batch_cond_uncond": true,
"fp8_storage": "Disable",
"cache_fp16_weight": false,
"hide_samplers": [],
"eta_ddim": 0,
"eta_ancestral": 1,
"ddim_discretize": "uniform",
"s_churn": 0,
"s_tmin": 0,
"s_tmax": 0,
"s_noise": 1,
"k_sched_type": "Automatic",
"sigma_min": 0.0,
"sigma_max": 0.0,
"rho": 0.0,
"eta_noise_seed_delta": 0,
"always_discard_next_to_last_sigma": false,
"sgm_noise_multiplier": false,
"uni_pc_variant": "bh1",
"uni_pc_skip_type": "time_uniform",
"uni_pc_order": 3,
"uni_pc_lower_order_final": true,
"sd_noise_schedule": "Default",
"sd_checkpoints_limit": 1,
"sd_checkpoints_keep_in_cpu": true,
"sd_checkpoint_cache": 0,
"sd_unet": "Automatic",
"enable_quantization": false,
"enable_emphasis": true,
"enable_batch_seeds": true,
"comma_padding_backtrack": 20,
"upcast_attn": false,
"randn_source": "GPU",
"tiling": false,
"hires_fix_refiner_pass": "second pass",
"sdxl_crop_top": 0.0,
"sdxl_crop_left": 0.0,
"sdxl_refiner_low_aesthetic_score": 2.5,
"sdxl_refiner_high_aesthetic_score": 6.0,
"sd_vae_checkpoint_cache": 0,
"sd_vae_overrides_per_model_preferences": true,
"auto_vae_precision_bfloat16": false,
"auto_vae_precision": true,
"sd_vae_encode_method": "Full",
"sd_vae_decode_method": "Full",
"inpainting_mask_weight": 1,
"initial_noise_multiplier": 1,
"img2img_extra_noise": 0,
"img2img_color_correction": false,
"img2img_fix_steps": false,
"img2img_background_color": "#ffffff",
"img2img_editor_height": 720,
"img2img_sketch_default_brush_color": "#ffffff",
"img2img_inpaint_mask_brush_color": "#ffffff",
"img2img_inpaint_sketch_default_brush_color": "#ffffff",
"return_mask": false,
"return_mask_composite": false,
"img2img_batch_show_results_limit": 32,
"overlay_inpaint": true,
"return_grid": true,
"do_not_show_images": false,
"js_modal_lightbox": true,
"js_modal_lightbox_initially_zoomed": true,
"js_modal_lightbox_gamepad": false,
"js_modal_lightbox_gamepad_repeat": 250.0,
"sd_webui_modal_lightbox_icon_opacity": 1,
"sd_webui_modal_lightbox_toolbar_opacity": 0.9,
"gallery_height": "",
"enable_pnginfo": true,
"save_txt": false,
"add_model_name_to_info": true,
"add_model_hash_to_info": true,
"add_vae_name_to_info": true,
"add_vae_hash_to_info": true,
"add_user_name_to_info": false,
"add_version_to_infotext": true,
"disable_weights_auto_swap": true,
"infotext_skip_pasting": [],
"infotext_styles": "Apply if any",
"show_progressbar": true,
"live_previews_enable": true,
"live_previews_image_format": "png",
"show_progress_grid": true,
"show_progress_every_n_steps": 10,
"show_progress_type": "Approx NN",
"live_preview_allow_lowvram_full": false,
"live_preview_content": "Prompt",
"live_preview_refresh_period": 1000.0,
"live_preview_fast_interrupt": false,
"js_live_preview_in_modal_lightbox": false,
"keyedit_precision_attention": 0.1,
"keyedit_precision_extra": 0.05,
"keyedit_delimiters": ".,\\/!?%^*;:{}=`~() ",
"keyedit_delimiters_whitespace": [
"Tab",
"Carriage Return",
"Line Feed"
],
"keyedit_move": true,
"disable_token_counters": false,
"extra_options_txt2img": [],
"extra_options_img2img": [],
"extra_options_cols": 1,
"extra_options_accordion": false,
"compact_prompt_box": false,
"samplers_in_dropdown": true,
"dimensions_and_batch_together": true,
"sd_checkpoint_dropdown_use_short": false,
"hires_fix_show_sampler": false,
"hires_fix_show_prompts": false,
"txt2img_settings_accordion": false,
"img2img_settings_accordion": false,
"interrupt_after_current": true,
"localization": "None",
"quicksettings_list": [
"sd_model_checkpoint",
"sd_vae",
"CLIP_stop_at_last_layers"
],
"ui_tab_order": [],
"hidden_tabs": [],
"ui_reorder_list": [],
"gradio_theme": "Default",
"gradio_themes_cache": true,
"show_progress_in_title": true,
"send_seed": true,
"send_size": true,
"api_enable_requests": true,
"api_forbid_local_requests": true,
"api_useragent": "",
"auto_launch_browser": "Disable",
"enable_console_prompts": false,
"show_warnings": false,
"show_gradio_deprecation_warnings": true,
"memmon_poll_rate": 8,
"samples_log_stdout": false,
"multiple_tqdm": true,
"enable_upscale_progressbar": true,
"print_hypernet_extra": false,
"list_hidden_files": true,
"disable_mmap_load_safetensors": false,
"hide_ldm_prints": true,
"dump_stacks_on_signal": false,
"face_restoration": false,
"face_restoration_model": "CodeFormer",
"code_former_weight": 0.5,
"face_restoration_unload": false,
"postprocessing_enable_in_main_ui": [],
"postprocessing_operation_order": [],
"upscaling_max_images_in_cache": 5,
"postprocessing_existing_caption_action": "Ignore",
"ESRGAN_tile": 192,
"ESRGAN_tile_overlap": 8,
"realesrgan_enabled_models": [
"R-ESRGAN 4x+",
"R-ESRGAN 4x+ Anime6B"
],
"dat_enabled_models": [
"DAT x2",
"DAT x3",
"DAT x4"
],
"DAT_tile": 192,
"DAT_tile_overlap": 8,
"unload_models_when_training": false,
"pin_memory": false,
"save_optimizer_state": false,
"save_training_settings_to_txt": true,
"dataset_filename_word_regex": "",
"dataset_filename_join_string": " ",
"training_image_repeats_per_epoch": 1,
"training_write_csv_every": 500.0,
"training_xattention_optimizations": false,
"training_enable_tensorboard": false,
"training_tensorboard_save_images": false,
"training_tensorboard_flush_every": 120.0,
"canvas_hotkey_zoom": "Alt",
"canvas_hotkey_adjust": "Ctrl",
"canvas_hotkey_shrink_brush": "Q",
"canvas_hotkey_grow_brush": "W",
"canvas_hotkey_move": "F",
"canvas_hotkey_fullscreen": "S",
"canvas_hotkey_reset": "R",
"canvas_hotkey_overlap": "O",
"canvas_show_tooltip": true,
"canvas_auto_expand": true,
"canvas_blur_prompt": false,
"canvas_disabled_functions": [
"Overlap"
],
"interrogate_keep_models_in_memory": false,
"interrogate_return_ranks": false,
"interrogate_clip_num_beams": 1,
"interrogate_clip_min_length": 24,
"interrogate_clip_max_length": 48,
"interrogate_clip_dict_limit": 1500.0,
"interrogate_clip_skip_categories": [],
"interrogate_deepbooru_score_threshold": 0.5,
"deepbooru_sort_alpha": true,
"deepbooru_use_spaces": true,
"deepbooru_escape": true,
"deepbooru_filter_tags": "",
"disabled_extensions": [],
"disable_all_extensions": "none",
"api_display_include_base64_images": false
},
"Startup": {
"total": 17.343299388885498,
"records": {
"initial startup": 0.017000675201416016,
"prepare environment/checks": 0.005998849868774414,
"prepare environment/git version info": 0.05500054359436035,
"prepare environment/torch GPU test": 1.1768434047698975,
"prepare environment/clone repositores": 0.08676338195800781,
"prepare environment/run extensions installers/sd-webui-api-payload-display": 0.0,
"prepare environment/run extensions installers": 0.0,
"prepare environment/run extensions_builtin installers/canvas-zoom-and-pan": 0.0,
"prepare environment/run extensions_builtin installers/extra-options-section": 0.0,
"prepare environment/run extensions_builtin installers/forge_legacy_preprocessors": 0.258209228515625,
"prepare environment/run extensions_builtin installers/forge_preprocessor_inpaint": 0.0,
"prepare environment/run extensions_builtin installers/forge_preprocessor_marigold": 0.0,
"prepare environment/run extensions_builtin installers/forge_preprocessor_normalbae": 0.0010027885437011719,
"prepare environment/run extensions_builtin installers/forge_preprocessor_recolor": 0.0,
"prepare environment/run extensions_builtin installers/forge_preprocessor_reference": 0.0,
"prepare environment/run extensions_builtin installers/forge_preprocessor_revision": 0.0,
"prepare environment/run extensions_builtin installers/forge_preprocessor_tile": 0.0,
"prepare environment/run extensions_builtin installers/LDSR": 0.0,
"prepare environment/run extensions_builtin installers/Lora": 0.0,
"prepare environment/run extensions_builtin installers/mobile": 0.0,
"prepare environment/run extensions_builtin installers/prompt-bracket-checker": 0.0,
"prepare environment/run extensions_builtin installers/ScuNET": 0.0,
"prepare environment/run extensions_builtin installers/sd_forge_controlllite": 0.0,
"prepare environment/run extensions_builtin installers/sd_forge_controlnet": 0.2556731700897217,
"prepare environment/run extensions_builtin installers/sd_forge_controlnet_example": 0.0,
"prepare environment/run extensions_builtin installers/sd_forge_dynamic_thresholding": 0.0,
"prepare environment/run extensions_builtin installers/sd_forge_fooocus_inpaint": 0.0,
"prepare environment/run extensions_builtin installers/sd_forge_freeu": 0.0,
"prepare environment/run extensions_builtin installers/sd_forge_hypertile": 0.0,
"prepare environment/run extensions_builtin installers/sd_forge_ipadapter": 0.0,
"prepare environment/run extensions_builtin installers/sd_forge_kohya_hrfix": 0.0,
"prepare environment/run extensions_builtin installers/sd_forge_latent_modifier": 0.0,
"prepare environment/run extensions_builtin installers/sd_forge_multidiffusion": 0.0,
"prepare environment/run extensions_builtin installers/sd_forge_neveroom": 0.0,
"prepare environment/run extensions_builtin installers/sd_forge_photomaker": 0.0,
"prepare environment/run extensions_builtin installers/sd_forge_sag": 0.0,
"prepare environment/run extensions_builtin installers/sd_forge_stylealign": 0.0,
"prepare environment/run extensions_builtin installers/sd_forge_svd": 0.0,
"prepare environment/run extensions_builtin installers/sd_forge_z123": 0.00099945068359375,
"prepare environment/run extensions_builtin installers/soft-inpainting": 0.0,
"prepare environment/run extensions_builtin installers/SwinIR": 0.0,
"prepare environment/run extensions_builtin installers": 0.5158846378326416,
"prepare environment": 1.8704910278320312,
"launcher": 0.0019991397857666016,
"import torch": 3.3309290409088135,
"import gradio": 0.9817752838134766,
"setup paths": 0.9001455307006836,
"import ldm": 0.005997180938720703,
"import sgm": 0.0,
"initialize shared": 0.09372973442077637,
"other imports": 0.38699841499328613,
"opts onchange": 0.001001596450805664,
"setup SD model": 0.0,
"setup codeformer": 0.0009996891021728516,
"setup gfpgan": 0.0070002079010009766,
"set samplers": 0.0,
"list extensions": 0.004000425338745117,
"restore config state file": 0.0,
"list SD models": 0.029000043869018555,
"list localizations": 0.0019998550415039062,
"load scripts/custom_code.py": 0.006000041961669922,
"load scripts/img2imgalt.py": 0.0,
"load scripts/loopback.py": 0.0009989738464355469,
"load scripts/outpainting_mk_2.py": 0.0,
"load scripts/poor_mans_outpainting.py": 0.0,
"load scripts/postprocessing_caption.py": 0.0010006427764892578,
"load scripts/postprocessing_codeformer.py": 0.0,
"load scripts/postprocessing_create_flipped_copies.py": 0.0,
"load scripts/postprocessing_focal_crop.py": 0.006000041961669922,
"load scripts/postprocessing_gfpgan.py": 0.0,
"load scripts/postprocessing_split_oversized.py": 0.0010004043579101562,
"load scripts/postprocessing_upscale.py": 0.0,
"load scripts/processing_autosized_crop.py": 0.0,
"load scripts/prompt_matrix.py": 0.0010027885437011719,
"load scripts/prompts_from_file.py": 0.0,
"load scripts/sd_upscale.py": 0.0,
"load scripts/xyz_grid.py": 0.0019979476928710938,
"load scripts/ldsr_model.py": 0.17399859428405762,
"load scripts/lora_script.py": 0.21199989318847656,
"load scripts/scunet_model.py": 0.03600049018859863,
"load scripts/swinir_model.py": 0.03300046920776367,
"load scripts/hotkey_config.py": 0.0,
"load scripts/extra_options_section.py": 0.0,
"load scripts/legacy_preprocessors.py": 0.009999990463256836,
"load scripts/preprocessor_inpaint.py": 0.010998964309692383,
"load scripts/preprocessor_marigold.py": 0.10700058937072754,
"load scripts/preprocessor_normalbae.py": 0.004999876022338867,
"load scripts/preprocessor_recolor.py": 0.0,
"load scripts/forge_reference.py": 0.0,
"load scripts/preprocessor_revision.py": 0.0010004043579101562,
"load scripts/preprocessor_tile.py": 0.0,
"load scripts/forge_controllllite.py": 0.008999824523925781,
"load scripts/controlnet.py": 3.4883952140808105,
"load scripts/xyz_grid_support.py": 0.0,
"load scripts/sd_forge_controlnet_example.py": 0.0,
"load scripts/forge_dynamic_thresholding.py": 0.004000663757324219,
"load scripts/forge_fooocus_inpaint.py": 0.0,
"load scripts/forge_freeu.py": 0.0030007362365722656,
"load scripts/forge_hypertile.py": 0.0019996166229248047,
"load scripts/forge_ipadapter.py": 0.006000041961669922,
"load scripts/kohya_hrfix.py": 0.003000020980834961,
"load scripts/forge_latent_modifier.py": 0.003000974655151367,
"load scripts/forge_multidiffusion.py": 0.005999088287353516,
"load scripts/forge_never_oom.py": 0.0,
"load scripts/forge_photomaker.py": 0.002999544143676758,
"load scripts/forge_sag.py": 0.002000093460083008,
"load scripts/forge_stylealign.py": 0.0,
"load scripts/forge_svd.py": 0.040143489837646484,
"load scripts/forge_z123.py": 0.03699994087219238,
"load scripts/soft_inpainting.py": 0.0010006427764892578,
"load scripts/api_payload_display.py": 0.03400087356567383,
"load scripts/comments.py": 0.03299832344055176,
"load scripts/refiner.py": 0.001001119613647461,
"load scripts/seed.py": 0.0,
"load scripts": 4.282540321350098,
"load upscalers": 0.00400090217590332,
"refresh VAE": 0.0019996166229248047,
"refresh textual inversion templates": 0.0,
"scripts list_optimizers": 0.023000001907348633,
"scripts list_unets": 0.0,
"reload hypernetworks": 0.0,
"initialize extra networks": 0.003000497817993164,
"scripts before_ui_callback": 0.000997781753540039,
"create ui": 0.7424488067626953,
"gradio launch": 4.477252721786499,
"add APIs": 0.20499110221862793,
"app_started_callback/lora_script.py": 0.0,
"app_started_callback/controlnet.py": 0.0,
"app_started_callback": 0.0
}
},
"Packages": [
"absl-py==2.1.0",
"accelerate==0.21.0",
"addict==2.4.0",
"aenum==3.1.15",
"aiofiles==23.2.1",
"aiohttp==3.9.3",
"aiosignal==1.3.1",
"ajc27-freemocap-blender-addon==2023.10.1016",
"albumentations==1.3.1",
"altair==5.2.0",
"aniposelib==0.4.3",
"antlr4-python3-runtime==4.9.3",
"anyio==3.7.1",
"asttokens==2.4.1",
"async-timeout==4.0.3",
"attrs==23.2.0",
"audioread==3.0.1",
"basicsr==1.4.2",
"blendmodes==2022",
"certifi==2022.12.7",
"cffi==1.16.0",
"chardet==5.2.0",
"charset-normalizer==2.1.1",
"clean-fid==0.1.35",
"click==8.1.7",
"clip==1.0",
"colorama==0.4.6",
"coloredlogs==15.0.1",
"colorlog==6.8.2",
"comm==0.2.1",
"contourpy==1.2.0",
"cssselect2==0.7.0",
"cycler==0.12.1",
"cython==3.0.8",
"debugpy==1.8.1",
"decorator==5.1.1",
"deffcode==0.2.5",
"deprecation==2.1.0",
"depth-anything==2024.1.22.0",
"diffusers==0.25.0",
"easydict==1.11",
"einops==0.4.1",
"embreex==2.17.7.post4",
"exceptiongroup==1.2.0",
"executing==2.0.1",
"facexlib==0.3.0",
"fastapi==0.94.0",
"ffmpy==0.3.2",
"filelock==3.9.0",
"filterpy==1.4.5",
"flatbuffers==23.5.26",
"fonttools==4.47.2",
"freemocap==1.1.0",
"frozenlist==1.4.1",
"fsspec==2024.3.1",
"ftfy==6.2.0",
"future==0.18.3",
"fvcore==0.1.5.post20221221",
"gitdb==4.0.11",
"gitpython==3.1.32",
"gradio-client==0.5.0",
"gradio==3.41.2",
"grpcio==1.60.1",
"h11==0.12.0",
"handrefinerportable==2024.2.12.0",
"httpcore==0.15.0",
"httpx==0.24.1",
"hub-sdk==0.0.4",
"huggingface-hub==0.20.3",
"humanfriendly==10.0",
"idna==3.4",
"ifnude==0.0.3",
"imageio-ffmpeg==0.4.9",
"imageio==2.33.1",
"importlib-metadata==7.0.1",
"importlib-resources==6.3.2",
"inflection==0.5.1",
"iniconfig==2.0.0",
"insightface==0.7.3",
"iopath==0.1.9",
"ipykernel==6.23.1",
"ipython==8.22.2",
"jedi==0.19.1",
"jinja2==3.1.2",
"joblib==1.3.2",
"jsonmerge==1.8.0",
"jsonschema-specifications==2023.12.1",
"jsonschema==4.21.1",
"jupyter-client==8.6.0",
"jupyter-core==5.7.1",
"kiwisolver==1.4.5",
"kornia==0.6.7",
"lark==1.1.2",
"lazy-loader==0.3",
"librosa==0.10.1",
"libsass==0.21.0",
"lightning-utilities==0.11.0",
"llvmlite==0.42.0",
"lmdb==1.4.1",
"lxml==5.1.0",
"mapbox-earcut==1.0.1",
"markdown-it-py==3.0.0",
"markdown==3.5.2",
"markupsafe==2.1.3",
"matplotlib-inline==0.1.6",
"matplotlib==3.8.2",
"mdurl==0.1.2",
"mediapipe==0.10.9",
"mpmath==1.3.0",
"msgpack==1.0.8",
"multidict==6.0.5",
"nest-asyncio==1.6.0",
"networkx==3.2.1",
"numba==0.59.0",
"numpy==1.26.2",
"omegaconf==2.2.3",
"onnx==1.14.0",
"onnxruntime==1.15.0",
"open-clip-torch==2.20.0",
"opencv-contrib-python==4.8.1.78",
"opencv-python-headless==4.9.0.80",
"opencv-python==4.9.0.80",
"orjson==3.9.15",
"packaging==23.2",
"pandas==2.1.4",
"parso==0.8.3",
"piexif==1.1.3",
"pillow==9.5.0",
"pip==24.0",
"platformdirs==4.2.0",
"plotly==5.14.1",
"pluggy==1.4.0",
"pooch==1.8.1",
"portalocker==2.8.2",
"prettytable==3.9.0",
"prompt-toolkit==3.0.43",
"protobuf==3.20.3",
"psutil==5.9.5",
"pure-eval==0.2.2",
"py-cpuinfo==9.0.0",
"pycollada==0.8",
"pycparser==2.21",
"pydantic==1.10.14",
"pydub==0.25.1",
"pygments==2.17.2",
"pymatting==1.1.12",
"pyparsing==3.1.1",
"pyqtgraph==0.13.3",
"pyreadline3==3.4.1",
"pyside6-addons==6.6.2",
"pyside6-essentials==6.6.2",
"pyside6==6.6.2",
"pytest==8.1.1",
"python-dateutil==2.8.2",
"python-multipart==0.0.9",
"pytorch-lightning==1.9.4",
"pytz==2024.1",
"pywavelets==1.5.0",
"pywin32==306",
"pyyaml==6.0.1",
"pyzmq==25.1.2",
"qtpy==2.4.1",
"qudida==0.0.4",
"referencing==0.34.0",
"regex==2023.12.25",
"rembg==2.0.56",
"reportlab==4.1.0",
"requests==2.28.1",
"resize-right==0.0.2",
"rich==13.7.0",
"rpds-py==0.18.0",
"rtree==1.2.0",
"safetensors==0.4.2",
"scikit-image==0.21.0",
"scikit-learn==1.4.0",
"scipy==1.11.4",
"seaborn==0.13.2",
"semantic-version==2.10.0",
"sentencepiece==0.2.0",
"setproctitle==1.3.3",
"setuptools==69.2.0",
"shapely==2.0.2",
"shiboken6==6.6.2",
"six==1.16.0",
"skelly-synchronize==2023.12.1029",
"skelly-viewer==2023.12.1020",
"skellycam==2023.12.1090",
"skellyforge==2023.12.1005",
"skellytracker==2024.1.1008",
"smmap==5.0.1",
"sniffio==1.3.1",
"sounddevice==0.4.6",
"soundfile==0.12.1",
"soxr==0.3.7",
"spandrel==0.1.6",
"stack-data==0.6.3",
"starlette==0.26.1",
"svg.path==6.3",
"svglib==1.5.1",
"sympy==1.12",
"tabulate==0.9.0",
"tb-nightly==2.16.0a20240204",
"tenacity==8.2.3",
"tensorboard-data-server==0.7.2",
"termcolor==2.4.0",
"tf-keras-nightly==2.16.0.dev2024020410",
"thop==0.1.1.post2209072238",
"threadpoolctl==3.2.0",
"tifffile==2023.12.9",
"timm==0.9.16",
"tinycss2==1.2.1",
"tokenizers==0.13.3",
"tomesd==0.1.3",
"toml==0.10.2",
"tomli==2.0.1",
"toolz==0.12.1",
"torch==2.2.0+cu121",
"torchaudio==2.2.0+cu121",
"torchdiffeq==0.2.3",
"torchmcubes==0.1.0",
"torchmetrics==1.3.2",
"torchsde==0.2.6",
"torchvision==0.17.0+cu121",
"tornado==6.4",
"tqdm==4.66.1",
"traitlets==5.14.1",
"trampoline==0.1.2",
"transformers==4.30.2",
"trimesh==4.0.5",
"typing-extensions==4.8.0",
"tzdata==2024.1",
"ultralytics==8.0.239",
"urllib3==1.26.13",
"uvicorn==0.29.0",
"vhacdx==0.0.5",
"wcwidth==0.2.13",
"webencodings==0.5.1",
"websockets==11.0.3",
"werkzeug==3.0.1",
"wheel==0.42.0",
"xxhash==3.4.1",
"yacs==0.1.8",
"yapf==0.40.2",
"yarl==1.9.4",
"zipp==3.17.0"
]
}

### Console logs

```Shell
Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug 1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Version: f0.0.17v1.8.0rc-latest-276-g29be1da7
Commit hash: 29be1da7cf2b5dccfc70fbdd33eb35c56a31ffb7
Launching Web UI with arguments: --api --listen --port 7865 --ckpt-dir D:\Documents\AI\ImgGen\stable-diffusion-webui/models/Stable-diffusion --hypernetwork-dir D:\Documents\AI\ImgGen\stable-diffusion-webui/models/hypernetworks --embeddings-dir D:\Documents\AI\ImgGen\stable-diffusion-webui/embeddings --lora-dir D:\Documents\AI\ImgGen\stable-diffusion-webui/models/Lora
Total VRAM 8192 MB, total RAM 31904 MB
Set vram state to: NORMAL_VRAM
Device: cuda:0 NVIDIA GeForce RTX 3070 : native
Hint: your device supports --pin-shared-memory for potential speed improvements.
Hint: your device supports --cuda-malloc for potential speed improvements.
Hint: your device supports --cuda-stream for potential speed improvements.
VAE dtype: torch.bfloat16
CUDA Stream Activated: False
Using pytorch cross attention
ControlNet preprocessor location: D:\Documents\AI\ImgGen\Forge\webui\models\ControlNetPreprocessor
Loading weights [d48c2391e0] from D:\Documents\AI\ImgGen\stable-diffusion-webui\models\Stable-diffusion\aamXLAnimeMix_v10.safetensors
2024-04-14 22:57:53,989 - ControlNet - INFO - ControlNet UI callback registered.
Running on local URL: http://0.0.0.0:7865
model_type EPS
UNet ADM Dimension 2816
Using pytorch attention in VAE
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
Using pytorch attention in VAE
extra {'cond_stage_model.clip_g.transformer.text_model.embeddings.position_ids', 'cond_stage_model.clip_l.text_projection', 'cond_stage_model.clip_l.transformer.text_model.embeddings.position_ids', 'cond_stage_model.clip_l.logit_scale'}
left over keys: dict_keys(['conditioner.embedders.0.logit_scale', 'conditioner.embedders.0.text_projection'])
To load target model SDXLClipModel
Begin to load 1 model
[Memory Management] Current Free GPU Memory (MB) = 7099.4189453125
[Memory Management] Model Memory (MB) = 2144.3546981811523
[Memory Management] Minimal Inference Memory (MB) = 1024.0
[Memory Management] Estimated Remaining GPU Memory (MB) = 3931.0642471313477
Moving model(s) has taken 0.53 seconds
Model loaded in 4.5s (load weights from disk: 0.4s, forge instantiate config: 1.1s, forge load real models: 1.8s, forge finalize: 0.2s, load VAE: 0.2s, calculate empty prompt: 0.7s).

To create a public link, set `share=True` in `launch()`.
Startup time: 17.3s (prepare environment: 1.9s, import torch: 3.3s, import gradio: 1.0s, setup paths: 0.9s, other imports: 0.4s, load scripts: 4.3s, create ui: 0.7s, gradio launch: 4.5s, add APIs: 0.2s).
```

### Additional information

_No response_

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the GET /controlnet/module_list API entry point and compare its response with the A1111 example in the issue. Trace how module_list data is assembled, then verify that the response includes module_detail with preprocessor slider information and matches the expected compatibility shape.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
api, backend
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Clearly specified
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.