lllyasviel / lllyasviel/stable-diffusion-webui-forge
[Bug]: "Batch Folder" cannot be used in txt2img's control net
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 13k
- Forks
- 1.7k
- PR merge metrics
- No merged PRs in 30d
Description
### Checklist
- [ ] The issue exists after disabling all extensions
- [ ] The issue exists on a clean installation of webui
- [X] The issue is caused by an extension, but I believe it is caused by a bug in the webui
- [X] The issue exists in the current version of the webui
- [ ] The issue has not been reported before recently
- [ ] The issue has been reported before but has not been fixed yet
### What happened?
"Batch Folder" cannot be used in txt2img's control net
### Steps to reproduce the problem
Enable ControlNet Integrated in txt2img and set the path to "Batch Folder" to generate
### What should have happened?
Generated based on images in "Batch Folder"
### What browsers do you use to access the UI ?
_No response_
### Sysinfo
{
"Platform": "Windows-10-10.0.19045-SP0",
"Python": "3.10.4",
"Version": "f0.0.16v1.8.0rc-latest-238-g437c3489",
"Commit": "437c348926c9ee1bfe1f147529f164bb93f731a1",
"Script path": "C:\\Work\\forge",
"Data path": "C:\\Work\\forge",
"Extensions dir": "C:\\Work\\forge\\extensions",
"Checksum": "bbf7db246bf19f2af9c355a4baca96d212d8fa712695b652bbd2779350a260ac",
"Commandline": [
"launch.py",
"--forge-ref-a1111-home",
"C:\\Work\\stable-diffusion-webui",
"--no-half-vae",
"--ckpt-dir",
"C:\\Work\\stable-diffusion-webui\\models\\Stable-diffusion",
"--vae-dir",
"C:\\Work\\stable-diffusion-webui\\models\\VAE",
"--hypernetwork-dir",
"C:\\Work\\stable-diffusion-webui\\models\\hypernetworks",
"--embeddings-dir",
"C:\\Work\\stable-diffusion-webui\\embeddings",
"--lora-dir",
"C:\\Work\\stable-diffusion-webui\\models\\lora",
"--controlnet-dir",
"C:\\Work\\stable-diffusion-webui\\models\\ControlNet",
"--controlnet-preprocessor-models-dir",
"C:\\Work\\stable-diffusion-webui\\extensions\\sd-webui-controlnet\\annotator\\downloads"
],
"Torch env info": {
"torch_version": "2.1.2+cu121",
"is_debug_build": "False",
"cuda_compiled_version": "12.1",
"gcc_version": null,
"clang_version": null,
"cmake_version": null,
"os": "Microsoft Windows 10 Pro",
"libc_version": "N/A",
"python_version": "3.10.4 (tags/v3.10.4:9d38120, Mar 23 2022, 23:13:41) [MSC v.1929 64 bit (AMD64)] (64-bit runtime)",
"python_platform": "Windows-10-10.0.19045-SP0",
"is_cuda_available": "True",
"cuda_runtime_version": "11.8.89\r",
"cuda_module_loading": "LAZY",
"nvidia_driver_version": "551.23",
"nvidia_gpu_models": "GPU 0: NVIDIA GeForce RTX 4070 Ti",
"cudnn_version": null,
"pip_version": "pip3",
"pip_packages": [
"numpy==1.26.2",
"open-clip-torch==2.20.0",
"pytorch-lightning==1.9.4",
"torch==2.1.2+cu121",
"torchdiffeq==0.2.3",
"torchmetrics==1.3.1",
"torchsde==0.2.6",
"torchvision==0.16.2+cu121"
],
"conda_packages": null,
"hip_compiled_version": "N/A",
"hip_runtime_version": "N/A",
"miopen_runtime_version": "N/A",
"caching_allocator_config": "",
"is_xnnpack_available": "True",
"cpu_info": [
"Architecture=9",
"CurrentClockSpeed=3801",
"DeviceID=CPU0",
"Family=107",
"L2CacheSize=4096",
"L2CacheSpeed=",
"Manufacturer=AuthenticAMD",
"MaxClockSpeed=3801",
"Name=AMD Ryzen 7 5800X 8-Core Processor ",
"ProcessorType=3",
"Revision=8448"
]
},
"Exceptions": [
{
"exception": "0",
"traceback": [
[
"C:\\Work\\forge\\modules\\scripts.py, line 859, postprocess_batch_list",
"script.postprocess_batch_list(p, pp, *script_args, **kwargs)"
],
[
"C:\\venv\\lib\\site-packages\\torch\\utils\\_contextlib.py, line 115, decorate_context",
"return func(*args, **kwargs)"
],
[
"C:\\Work\\forge\\extensions-builtin\\sd_forge_controlnet\\scripts\\controlnet.py, line 561, postprocess_batch_list",
"self.process_unit_after_every_sampling(p, unit, self.current_params[i], pp, *args, **kwargs)"
]
]
},
{
"exception": "0",
"traceback": [
[
"C:\\Work\\forge\\modules\\scripts.py, line 835, process_before_every_sampling",
"script.process_before_every_sampling(p, *script_args, **kwargs)"
],
[
"C:\\venv\\lib\\site-packages\\torch\\utils\\_contextlib.py, line 115, decorate_context",
"return func(*args, **kwargs)"
],
[
"C:\\Work\\forge\\extensions-builtin\\sd_forge_controlnet\\scripts\\controlnet.py, line 555, process_before_every_sampling",
"self.process_unit_before_every_sampling(p, unit, self.current_params[i], *args, **kwargs)"
]
]
},
{
"exception": "0",
"traceback": [
[
"C:\\Work\\forge\\modules\\scripts.py, line 835, process_before_every_sampling",
"script.process_before_every_sampling(p, *script_args, **kwargs)"
],
[
"C:\\venv\\lib\\site-packages\\torch\\utils\\_contextlib.py, line 115, decorate_context",
"return func(*args, **kwargs)"
],
[
"C:\\Work\\forge\\extensions-builtin\\sd_forge_controlnet\\scripts\\controlnet.py, line 555, process_before_every_sampling",
"self.process_unit_before_every_sampling(p, unit, self.current_params[i], *args, **kwargs)"
]
]
},
{
"exception": "'NoneType' object is not subscriptable",
"traceback": [
[
"C:\\Work\\forge\\modules\\scripts.py, line 803, process",
"script.process(p, *script_args)"
],
[
"C:\\venv\\lib\\site-packages\\torch\\utils\\_contextlib.py, line 115, decorate_context",
"return func(*args, **kwargs)"
],
[
"C:\\Work\\forge\\extensions-builtin\\sd_forge_controlnet\\scripts\\controlnet.py, line 548, process",
"self.process_unit_after_click_generate(p, unit, params, *args, **kwargs)"
],
[
"C:\\venv\\lib\\site-packages\\torch\\utils\\_contextlib.py, line 115, decorate_context",
"return func(*args, **kwargs)"
],
[
"C:\\Work\\forge\\extensions-builtin\\sd_forge_controlnet\\scripts\\controlnet.py, line 298, process_unit_after_click_generate",
"input_list, resize_mode = self.get_input_data(p, unit, preprocessor, h, w)"
],
[
"C:\\Work\\forge\\extensions-builtin\\sd_forge_controlnet\\scripts\\controlnet.py, line 182, get_input_data",
"img = np.ascontiguousarray(cv2.imread(img_path)[:, :, ::-1]).copy()"
]
]
},
{
"exception": "0",
"traceback": [
[
"C:\\Work\\forge\\modules\\scripts.py, line 859, postprocess_batch_list",
"script.postprocess_batch_list(p, pp, *script_args, **kwargs)"
],
[
"C:\\venv\\lib\\site-packages\\torch\\utils\\_contextlib.py, line 115, decorate_context",
"return func(*args, **kwargs)"
],
[
"C:\\Work\\forge\\extensions-builtin\\sd_forge_controlnet\\scripts\\controlnet.py, line 561, postprocess_batch_list",
"self.process_unit_after_every_sampling(p, unit, self.current_params[i], pp, *args, **kwargs)"
]
]
}
],
"CPU": {
"model": "AMD64 Family 25 Model 33 Stepping 0, AuthenticAMD",
"count logical": 16,
"count physical": 8
},
"RAM": {
"total": "32GB",
"used": "13GB",
"free": "19GB"
},
"Extensions": [
{
"name": "sd-dynamic-prompts",
"path": "C:\\Work\\forge\\extensions\\sd-dynamic-prompts",
"version": "74991820",
"branch": "main",
"remote": "https://github.com/adieyal/sd-dynamic-prompts.git"
}
],
"Inactive extensions": [],
"Environment": {
"COMMANDLINE_ARGS": " --forge-ref-a1111-home \"C:\\Work\\stable-diffusion-webui\" --no-half-vae",
"GRADIO_ANALYTICS_ENABLED": "False"
},
"Config": {
"sd_checkpoint_hash": "48c4cec1313f386b09feb0abd6a466c72ac5aa5f4ac6c76b54881ef1447cd886",
"ldsr_steps": 100,
"ldsr_cached": false,
"SCUNET_tile": 256,
"SCUNET_tile_overlap": 8,
"SWIN_tile": 192,
"SWIN_tile_overlap": 8,
"SWIN_torch_compile": false,
"control_net_detectedmap_dir": "detected_maps",
"control_net_models_path": "",
"control_net_modules_path": "",
"control_net_unit_count": 1,
"control_net_model_cache_size": 5,
"control_net_no_detectmap": false,
"control_net_detectmap_autosaving": false,
"control_net_allow_script_control": false,
"control_net_sync_field_args": true,
"controlnet_show_batch_images_in_ui": false,
"controlnet_increment_seed_during_batch": false,
"controlnet_disable_openpose_edit": false,
"controlnet_disable_photopea_edit": false,
"controlnet_photopea_warning": true,
"controlnet_input_thumbnail": true,
"sd_model_checkpoint": "chilled_remix_v2.safetensors",
"sd_vae": "None",
"outdir_samples": "",
"outdir_txt2img_samples": "output\\txt2img-images",
"outdir_img2img_samples": "output\\img2img-images",
"outdir_extras_samples": "output\\extras-images",
"outdir_grids": "",
"outdir_txt2img_grids": "output\\txt2img-grids",
"outdir_img2img_grids": "output\\img2img-grids",
"outdir_save": "log\\images",
"outdir_init_images": "output\\init-images",
"samples_save": true,
"samples_format": "png",
"samples_filename_pattern": "",
"save_images_add_number": true,
"save_images_replace_action": "Replace",
"grid_save": true,
"grid_format": "png",
"grid_extended_filename": false,
"grid_only_if_multiple": true,
"grid_prevent_empty_spots": false,
"grid_zip_filename_pattern": "",
"n_rows": -1,
"font": "",
"grid_text_active_color": "#000000",
"grid_text_inactive_color": "#999999",
"grid_background_color": "#ffffff",
"save_images_before_face_restoration": false,
"save_images_before_highres_fix": false,
"save_images_before_color_correction": false,
"save_mask": false,
"save_mask_composite": false,
"jpeg_quality": 80,
"webp_lossless": false,
"export_for_4chan": true,
"img_downscale_threshold": 4.0,
"target_side_length": 4000.0,
"img_max_size_mp": 200.0,
"use_original_name_batch": true,
"use_upscaler_name_as_suffix": false,
"save_selected_only": true,
"save_init_img": false,
"temp_dir": "",
"clean_temp_dir_at_start": false,
"save_incomplete_images": false,
"notification_audio": true,
"notification_volume": 100,
"save_to_dirs": true,
"grid_save_to_dirs": true,
"use_save_to_dirs_for_ui": false,
"directories_filename_pattern": "[date]",
"directories_max_prompt_words": 8,
"auto_backcompat": true,
"use_old_emphasis_implementation": false,
"use_old_karras_scheduler_sigmas": false,
"no_dpmpp_sde_batch_determinism": false,
"use_old_hires_fix_width_height": false,
"dont_fix_second_order_samplers_schedule": false,
"hires_fix_use_firstpass_conds": false,
"use_old_scheduling": false,
"use_downcasted_alpha_bar": false,
"lora_functional": false,
"extra_networks_show_hidden_directories": true,
"extra_networks_dir_button_function": false,
"extra_networks_hidden_models": "When searched",
"extra_networks_default_multiplier": 1,
"extra_networks_card_width": 0.0,
"extra_networks_card_height": 0.0,
"extra_networks_card_text_scale": 1,
"extra_networks_card_show_desc": true,
"extra_networks_card_description_is_html": false,
"extra_networks_card_order_field": "Path",
"extra_networks_card_order": "Ascending",
"extra_networks_tree_view_default_enabled": false,
"extra_networks_add_text_separator": " ",
"ui_extra_networks_tab_reorder": "",
"textual_inversion_print_at_load": false,
"textual_inversion_add_hashes_to_infotext": true,
"sd_hypernetwork": "None",
"sd_lora": "None",
"lora_preferred_name": "Alias from file",
"lora_add_hashes_to_infotext": true,
"lora_show_all": false,
"lora_hide_unknown_for_versions": [],
"lora_in_memory_limit": 0,
"lora_not_found_warning_console": false,
"lora_not_found_gradio_warning": false,
"cross_attention_optimization": "Automatic",
"s_min_uncond": 0,
"token_merging_ratio": 0,
"token_merging_ratio_img2img": 0,
"token_merging_ratio_hr": 0,
"pad_cond_uncond": false,
"pad_cond_uncond_v0": false,
"persistent_cond_cache": true,
"batch_cond_uncond": true,
"fp8_storage": "Disable",
"cache_fp16_weight": false,
"hide_samplers": [],
"eta_ddim": 0,
"eta_ancestral": 1,
"ddim_discretize": "uniform",
"s_churn": 0,
"s_tmin": 0,
"s_tmax": 0,
"s_noise": 1,
"k_sched_type": "Automatic",
"sigma_min": 0.0,
"sigma_max": 0.0,
"rho": 0.0,
"eta_noise_seed_delta": 0,
"always_discard_next_to_last_sigma": false,
"sgm_noise_multiplier": false,
"uni_pc_variant": "bh1",
"uni_pc_skip_type": "time_uniform",
"uni_pc_order": 3,
"uni_pc_lower_order_final": true,
"sd_noise_schedule": "Default",
"sd_checkpoints_limit": 1,
"sd_checkpoints_keep_in_cpu": true,
"sd_checkpoint_cache": 0,
"sd_unet": "Automatic",
"enable_quantization": false,
"emphasis": "Original",
"enable_batch_seeds": true,
"comma_padding_backtrack": 20,
"upcast_attn": false,
"randn_source": "GPU",
"tiling": false,
"hires_fix_refiner_pass": "second pass",
"enable_prompt_comments": true,
"sdxl_crop_top": 0.0,
"sdxl_crop_left": 0.0,
"sdxl_refiner_low_aesthetic_score": 2.5,
"sdxl_refiner_high_aesthetic_score": 6.0,
"sd_vae_checkpoint_cache": 0,
"sd_vae_overrides_per_model_preferences": true,
"auto_vae_precision_bfloat16": false,
"auto_vae_precision": true,
"sd_vae_encode_method": "Full",
"sd_vae_decode_method": "Full",
"inpainting_mask_weight": 1,
"initial_noise_multiplier": 1,
"img2img_extra_noise": 0,
"img2img_color_correction": false,
"img2img_fix_steps": false,
"img2img_background_color": "#ffffff",
"img2img_editor_height": 720,
"img2img_sketch_default_brush_color": "#ffffff",
"img2img_inpaint_mask_brush_color": "#ffffff",
"img2img_inpaint_sketch_default_brush_color": "#ffffff",
"return_mask": false,
"return_mask_composite": false,
"img2img_batch_show_results_limit": 32,
"overlay_inpaint": true,
"return_grid": true,
"do_not_show_images": false,
"js_modal_lightbox": true,
"js_modal_lightbox_initially_zoomed": true,
"js_modal_lightbox_gamepad": false,
"js_modal_lightbox_gamepad_repeat": 250.0,
"sd_webui_modal_lightbox_icon_opacity": 1,
"sd_webui_modal_lightbox_toolbar_opacity": 0.9,
"gallery_height": "",
"open_dir_button_choice": "Subdirectory",
"enable_pnginfo": true,
"save_txt": false,
"add_model_name_to_info": true,
"add_model_hash_to_info": true,
"add_vae_name_to_info": true,
"add_vae_hash_to_info": true,
"add_user_name_to_info": false,
"add_version_to_infotext": true,
"disable_weights_auto_swap": true,
"infotext_skip_pasting": [],
"infotext_styles": "Apply if any",
"show_progressbar": true,
"live_previews_enable": true,
"live_previews_image_format": "png",
"show_progress_grid": true,
"show_progress_every_n_steps": 10,
"show_progress_type": "Approx NN",
"live_preview_allow_lowvram_full": false,
"live_preview_content": "Prompt",
"live_preview_refresh_period": 1000.0,
"live_preview_fast_interrupt": false,
"js_live_preview_in_modal_lightbox": false,
"keyedit_precision_attention": 0.1,
"keyedit_precision_extra": 0.05,
"keyedit_delimiters": ".,\\/!?%^*;:{}=`~() ",
"keyedit_delimiters_whitespace": [
"Tab",
"Carriage Return",
"Line Feed"
],
"keyedit_move": true,
"disable_token_counters": false,
"include_styles_into_token_counters": true,
"extra_options_txt2img": [],
"extra_options_img2img": [],
"extra_options_cols": 1,
"extra_options_accordion": false,
"compact_prompt_box": false,
"samplers_in_dropdown": true,
"dimensions_and_batch_together": true,
"sd_checkpoint_dropdown_use_short": false,
"hires_fix_show_sampler": false,
"hires_fix_show_prompts": false,
"txt2img_settings_accordion": false,
"img2img_settings_accordion": false,
"interrupt_after_current": true,
"localization": "None",
"quicksettings_list": [
"sd_model_checkpoint",
"sd_vae",
"CLIP_stop_at_last_layers"
],
"ui_tab_order": [],
"hidden_tabs": [],
"ui_reorder_list": [],
"gradio_theme": "Default",
"gradio_themes_cache": true,
"show_progress_in_title": true,
"send_seed": true,
"send_size": true,
"api_enable_requests": true,
"api_forbid_local_requests": true,
"api_useragent": "",
"auto_launch_browser": "Local",
"enable_console_prompts": false,
"show_warnings": false,
"show_gradio_deprecation_warnings": true,
"memmon_poll_rate": 8,
"samples_log_stdout": false,
"multiple_tqdm": true,
"enable_upscale_progressbar": true,
"print_hypernet_extra": false,
"list_hidden_files": true,
"disable_mmap_load_safetensors": false,
"hide_ldm_prints": true,
"dump_stacks_on_signal": false,
"face_restoration": false,
"face_restoration_model": "CodeFormer",
"code_former_weight": 0.5,
"face_restoration_unload": false,
"postprocessing_enable_in_main_ui": [],
"postprocessing_operation_order": [],
"upscaling_max_images_in_cache": 5,
"postprocessing_existing_caption_action": "Ignore",
"ESRGAN_tile": 192,
"ESRGAN_tile_overlap": 8,
"realesrgan_enabled_models": [
"R-ESRGAN 4x+",
"R-ESRGAN 4x+ Anime6B"
],
"dat_enabled_models": [
"DAT x2",
"DAT x3",
"DAT x4"
],
"DAT_tile": 192,
"DAT_tile_overlap": 8,
"unload_models_when_training": false,
"pin_memory": false,
"save_optimizer_state": false,
"save_training_settings_to_txt": true,
"dataset_filename_word_regex": "",
"dataset_filename_join_string": " ",
"training_image_repeats_per_epoch": 1,
"training_write_csv_every": 500.0,
"training_xattention_optimizations": false,
"training_enable_tensorboard": false,
"training_tensorboard_save_images": false,
"training_tensorboard_flush_every": 120.0,
"canvas_hotkey_zoom": "Alt",
"canvas_hotkey_adjust": "Ctrl",
"canvas_hotkey_shrink_brush": "Q",
"canvas_hotkey_grow_brush": "W",
"canvas_hotkey_move": "F",
"canvas_hotkey_fullscreen": "S",
"canvas_hotkey_reset": "R",
"canvas_hotkey_overlap": "O",
"canvas_show_tooltip": true,
"canvas_auto_expand": true,
"canvas_blur_prompt": false,
"canvas_disabled_functions": [
"Overlap"
],
"interrogate_keep_models_in_memory": false,
"interrogate_return_ranks": false,
"interrogate_clip_num_beams": 1,
"interrogate_clip_min_length": 24,
"interrogate_clip_max_length": 48,
"interrogate_clip_dict_limit": 1500.0,
"interrogate_clip_skip_categories": [],
"interrogate_deepbooru_score_threshold": 0.5,
"deepbooru_sort_alpha": true,
"deepbooru_use_spaces": true,
"deepbooru_escape": true,
"deepbooru_filter_tags": "",
"dp_ignore_whitespace": false,
"dp_write_raw_template": false,
"dp_write_prompts_to_file": false,
"dp_parser_variant_start": "{",
"dp_parser_variant_end": "}",
"dp_parser_wildcard_wrap": "__",
"dp_limit_jinja_prompts": false,
"dp_auto_purge_cache": false,
"dp_wildcard_manager_no_dedupe": false,
"dp_wildcard_manager_no_sort": false,
"dp_wildcard_manager_shuffle": false,
"dp_magicprompt_default_model": "Gustavosta/MagicPrompt-Stable-Diffusion",
"dp_magicprompt_batch_size": 1,
"disabled_extensions": [],
"disable_all_extensions": "none",
"control_net_model_config": "models\\cldm_v15.yaml",
"control_net_model_adapter_config": "models\\t2iadapter_sketch_sd14v1.yaml",
"control_net_max_models_num": 3,
"control_net_inpaint_blur_sigma": 7,
"control_net_no_high_res_fix": false,
"controlnet_disable_control_type": false,
"controlnet_ignore_noninpaint_mask": false,
"comfyui_enabled": true,
"comfyui_update_button": "Update comfyui (requires reload ui)",
"comfyui_install_location": "C:\\Work\\forge\\extensions\\sd-webui-comfyui\\ComfyUI",
"comfyui_additional_args": "",
"comfyui_client_address": "",
"comfyui_ipc_strategy": "Default",
"comfyui_graceful_termination_timeout": 5,
"comfyui_reverse_proxy_enabled": "Default",
"comfyui_reverse_proxy_disable_port": false,
"CLIP_stop_at_last_layers": 1
},
"Startup": {
"total": 39.16495943069458,
"records": {
"initial startup": 0.037034034729003906,
"prepare environment/checks": 0.011010408401489258,
"prepare environment/git version info": 0.1481342315673828,
"prepare environment/torch GPU test": 4.201433181762695,
"prepare environment/clone repositores": 0.2551689147949219,
"prepare environment/run extensions installers/sd-dynamic-prompts": 0.2702457904815674,
"prepare environment/run extensions installers": 0.2702457904815674,
"prepare environment/run extensions_builtin installers/canvas-zoom-and-pan": 0.001001119613647461,
"prepare environment/run extensions_builtin installers/extra-options-section": 0.001001119613647461,
"prepare environment/run extensions_builtin installers/forge_legacy_preprocessors": 0.4574153423309326,
"prepare environment/run extensions_builtin installers/forge_preprocessor_inpaint": 0.0,
"prepare environment/run extensions_builtin installers/forge_preprocessor_marigold": 0.0,
"prepare environment/run extensions_builtin installers/forge_preprocessor_normalbae": 0.0010006427764892578,
"prepare environment/run extensions_builtin installers/forge_preprocessor_recolor": 0.0,
"prepare environment/run extensions_builtin installers/forge_preprocessor_reference": 0.0,
"prepare environment/run extensions_builtin installers/forge_preprocessor_revision": 0.0,
"prepare environment/run extensions_builtin installers/forge_preprocessor_tile": 0.0,
"prepare environment/run extensions_builtin installers/LDSR": 0.0010006427764892578,
"prepare environment/run extensions_builtin installers/Lora": 0.0,
"prepare environment/run extensions_builtin installers/mobile": 0.0,
"prepare environment/run extensions_builtin installers/prompt-bracket-checker": 0.0,
"prepare environment/run extensions_builtin installers/ScuNET": 0.0010013580322265625,
"prepare environment/run extensions_builtin installers/sd_forge_controlllite": 0.0,
"prepare environment/run extensions_builtin installers/sd_forge_controlnet": 0.38234639167785645,
"prepare environment/run extensions_builtin installers/sd_forge_controlnet_example": 0.001001596450805664,
"prepare environment/run extensions_builtin installers/sd_forge_dynamic_thresholding": 0.002001047134399414,
"prepare environment/run extensions_builtin installers/sd_forge_fooocus_inpaint": 0.002003192901611328,
"prepare environment/run extensions_builtin installers/sd_forge_freeu": 0.0,
"prepare environment/run extensions_builtin installers/sd_forge_hypertile": 0.0010004043579101562,
"prepare environment/run extensions_builtin installers/sd_forge_ipadapter": 0.0,
"prepare environment/run extensions_builtin installers/sd_forge_kohya_hrfix": 0.0010008811950683594,
"prepare environment/run extensions_builtin installers/sd_forge_latent_modifier": 0.0,
"prepare environment/run extensions_builtin installers/sd_forge_multidiffusion": 0.0010008811950683594,
"prepare environment/run extensions_builtin installers/sd_forge_neveroom": 0.0,
"prepare environment/run extensions_builtin installers/sd_forge_photomaker": 0.0,
"prepare environment/run extensions_builtin installers/sd_forge_sag": 0.001001119613647461,
"prepare environment/run extensions_builtin installers/sd_forge_stylealign": 0.0010006427764892578,
"prepare environment/run extensions_builtin installers/sd_forge_svd": 0.0010001659393310547,
"prepare environment/run extensions_builtin installers/sd_forge_z123": 0.001001119613647461,
"prepare environment/run extensions_builtin installers/soft-inpainting": 0.0,
"prepare environment/run extensions_builtin installers/SwinIR": 0.001001119613647461,
"prepare environment/run extensions_builtin installers": 0.857778787612915,
"prepare environment": 5.807829141616821,
"launcher": 0.012011289596557617,
"import torch": 5.7711498737335205,
"import gradio": 1.4574573040008545,
"setup paths": 1.5924458503723145,
"import ldm": 0.010010242462158203,
"import sgm": 0.0,
"initialize shared": 0.22420310974121094,
"other imports": 0.9018194675445557,
"opts onchange": 0.0009996891021728516,
"setup SD model": 0.0,
"setup codeformer": 0.0020024776458740234,
"setup gfpgan": 0.024021387100219727,
"set samplers": 0.0,
"list extensions": 0.0050046443939208984,
"restore config state file": 0.0,
"list SD models": 0.42438507080078125,
"list localizations": 0.002001523971557617,
"load scripts/custom_code.py": 0.04304027557373047,
"load scripts/img2imgalt.py": 0.002001047134399414,
"load scripts/loopback.py": 0.001001119613647461,
"load scripts/outpainting_mk_2.py": 0.0010006427764892578,
"load scripts/poor_mans_outpainting.py": 0.0010008811950683594,
"load scripts/postprocessing_caption.py": 0.006005048751831055,
"load scripts/postprocessing_codeformer.py": 0.0010008811950683594,
"load scripts/postprocessing_create_flipped_copies.py": 0.001001119613647461,
"load scripts/postprocessing_focal_crop.py": 0.009008407592773438,
"load scripts/postprocessing_gfpgan.py": 0.0,
"load scripts/postprocessing_split_oversized.py": 0.0010006427764892578,
"load scripts/postprocessing_upscale.py": 0.0,
"load scripts/processing_autosized_crop.py": 0.001001596450805664,
"load scripts/prompt_matrix.py": 0.0,
"load scripts/prompts_from_file.py": 0.0010008811950683594,
"load scripts/sd_upscale.py": 0.0010008811950683594,
"load scripts/xyz_grid.py": 0.0030024051666259766,
"load scripts/ldsr_model.py": 0.835561990737915,
"load scripts/lora_script.py": 3.429114580154419,
"load scripts/scunet_model.py": 0.053047895431518555,
"load scripts/swinir_model.py": 0.054049015045166016,
"load scripts/hotkey_config.py": 0.0010008811950683594,
"load scripts/extra_options_section.py": 0.0,
"load scripts/legacy_preprocessors.py": 0.016014814376831055,
"load scripts/preprocessor_inpaint.py": 0.02101874351501465,
"load scripts/preprocessor_marigold.py": 0.3813457489013672,
"load scripts/preprocessor_normalbae.py": 0.010009050369262695,
"load scripts/preprocessor_recolor.py": 0.0010013580322265625,
"load scripts/forge_reference.py": 0.0,
"load scripts/preprocessor_revision.py": 0.001001119613647461,
"load scripts/preprocessor_tile.py": 0.0,
"load scripts/forge_controllllite.py": 0.014011859893798828,
"load scripts/controlnet.py": 0.7268187999725342,
"load scripts/xyz_grid_support.py": 0.0020017623901367188,
"load scripts/sd_forge_controlnet_example.py": 0.0010006427764892578,
"load scripts/forge_dynamic_thresholding.py": 0.0060062408447265625,
"load scripts/forge_fooocus_inpaint.py": 0.0009996891021728516,
"load scripts/forge_freeu.py": 0.005006313323974609,
"load scripts/forge_hypertile.py": 0.004003286361694336,
"load scripts/forge_ipadapter.py": 0.01000833511352539,
"load scripts/kohya_hrfix.py": 0.0040035247802734375,
"load scripts/forge_latent_modifier.py": 0.007665872573852539,
"load scripts/forge_multidiffusion.py": 0.01101064682006836,
"load scripts/forge_never_oom.py": 0.0,
"load scripts/forge_photomaker.py": 0.005004405975341797,
"load scripts/forge_sag.py": 0.005004405975341797,
"load scripts/forge_stylealign.py": 0.001001119613647461,
"load scripts/forge_svd.py": 0.06205630302429199,
"load scripts/forge_z123.py": 0.06305694580078125,
"load scripts/soft_inpainting.py": 0.0010004043579101562,
"load scripts/dynamic_prompting.py": 0.08808040618896484,
"load scripts/comments.py": 0.07406759262084961,
"load scripts/refiner.py": 0.0010008811950683594,
"load scripts/seed.py": 0.0,
"load scripts": 5.968040466308594,
"load upscalers": 0.0070056915283203125,
"refresh VAE": 0.0040051937103271484,
"refresh textual inversion templates": 0.0,
"scripts list_optimizers": 0.04604029655456543,
"scripts list_unets": 0.0,
"reload hypernetworks": 0.0,
"initialize extra networks": 0.00700688362121582,
"scripts before_ui_callback": 0.0020017623901367188,
"create ui": 16.545198917388916,
"gradio launch": 0.37033581733703613,
"add APIs": 0.0060062408447265625,
"app_started_callback/lora_script.py": 0.0,
"app_started_callback/controlnet.py": 0.0010008811950683594,
"app_started_callback": 0.0010008811950683594
}
},
"Packages": [
"absl-py==2.1.0",
"accelerate==0.21.0",
"addict==2.4.0",
"aenum==3.1.15",
"aiofiles==23.2.1",
"aiohttp==3.9.3",
"aiosignal==1.3.1",
"albumentations==1.4.0",
"altair==5.2.0",
"antlr4-python3-runtime==4.9.3",
"anyio==3.7.1",
"async-timeout==4.0.3",
"attrs==23.2.0",
"basicsr==1.4.2",
"blendmodes==2022",
"certifi==2024.2.2",
"cffi==1.16.0",
"chardet==5.2.0",
"charset-normalizer==3.3.2",
"clean-fid==0.1.35",
"click==8.1.7",
"clip==1.0",
"colorama==0.4.6",
"coloredlogs==15.0.1",
"colorlog==6.8.2",
"contourpy==1.2.0",
"cssselect2==0.7.0",
"cycler==0.12.1",
"cython==3.0.8",
"deprecation==2.1.0",
"depth-anything==2024.1.22.0",
"diffusers==0.25.0",
"dynamicprompts==0.30.4",
"easydict==1.12",
"einops==0.4.1",
"embreex==2.17.7.post4",
"exceptiongroup==1.2.0",
"facexlib==0.3.0",
"fastapi==0.94.0",
"ffmpy==0.3.2",
"filelock==3.13.1",
"filterpy==1.4.5",
"flatbuffers==23.5.26",
"fonttools==4.49.0",
"frozenlist==1.4.1",
"fsspec==2024.2.0",
"ftfy==6.1.3",
"future==1.0.0",
"fvcore==0.1.5.post20221221",
"gitdb==4.0.11",
"gitpython==3.1.32",
"gradio-client==0.5.0",
"gradio==3.41.2",
"grpcio==1.62.0",
"h11==0.12.0",
"handrefinerportable==2024.2.12.0",
"httpcore==0.15.0",
"httpx==0.24.1",
"huggingface-hub==0.20.3",
"humanfriendly==10.0",
"idna==3.6",
"imageio==2.34.0",
"importlib-metadata==7.0.1",
"importlib-resources==6.1.1",
"inflection==0.5.1",
"insightface==0.7.3",
"iopath==0.1.9",
"jax==0.4.24",
"jinja2==3.1.3",
"joblib==1.3.2",
"jsonmerge==1.8.0",
"jsonschema-specifications==2023.12.1",
"jsonschema==4.21.1",
"kiwisolver==1.4.5",
"kornia==0.6.7",
"lark==1.1.2",
"lazy-loader==0.3",
"lightning-utilities==0.10.1",
"llvmlite==0.42.0",
"lmdb==1.4.1",
"lxml==5.1.0",
"mapbox-earcut==1.0.1",
"markdown==3.5.2",
"markupsafe==2.1.5",
"matplotlib==3.8.3",
"mediapipe==0.10.10",
"ml-dtypes==0.3.2",
"mpmath==1.3.0",
"multidict==6.0.5",
"networkx==3.2.1",
"numba==0.59.0",
"numpy==1.26.2",
"omegaconf==2.2.3",
"onnx==1.15.0",
"onnxruntime==1.17.1",
"open-clip-torch==2.20.0",
"opencv-contrib-python==4.9.0.80",
"opencv-python-headless==4.9.0.80",
"opencv-python==4.9.0.80",
"opt-einsum==3.3.0",
"orjson==3.9.15",
"packaging==23.2",
"pandas==2.2.1",
"piexif==1.1.3",
"pillow==9.5.0",
"pip==22.0.4",
"platformdirs==4.2.0",
"portalocker==2.8.2",
"prettytable==3.10.0",
"protobuf==3.20.3",
"psutil==5.9.5",
"pycollada==0.8",
"pycparser==2.21",
"pydantic==1.10.14",
"pydub==0.25.1",
"pyparsing==3.1.1",
"pyreadline3==3.4.1",
"python-dateutil==2.8.2",
"python-multipart==0.0.9",
"pytorch-lightning==1.9.4",
"pytz==2024.1",
"pywavelets==1.5.0",
"pywin32==306",
"pyyaml==6.0.1",
"qudida==0.0.4",
"referencing==0.33.0",
"regex==2023.12.25",
"reportlab==4.1.0",
"requests==2.31.0",
"resize-right==0.0.2",
"rpds-py==0.18.0",
"rtree==1.2.0",
"safetensors==0.4.2",
"scikit-image==0.21.0",
"scikit-learn==1.4.1.post1",
"scipy==1.12.0",
"semantic-version==2.10.0",
"send2trash==1.8.2",
"sentencepiece==0.2.0",
"setuptools==58.1.0",
"shapely==2.0.3",
"six==1.16.0",
"smmap==5.0.1",
"sniffio==1.3.0",
"sounddevice==0.4.6",
"spandrel==0.1.6",
"starlette==0.26.1",
"svg.path==6.3",
"svglib==1.5.1",
"sympy==1.12",
"tabulate==0.9.0",
"tb-nightly==2.17.0a20240224",
"tensorboard-data-server==0.7.2",
"termcolor==2.4.0",
"threadpoolctl==3.3.0",
"tifffile==2024.2.12",
"timm==0.9.16",
"tinycss2==1.2.1",
"tokenizers==0.13.3",
"tomesd==0.1.3",
"tomli==2.0.1",
"toolz==0.12.1",
"torch==2.1.2+cu121",
"torchdiffeq==0.2.3",
"torchmetrics==1.3.1",
"torchsde==0.2.6",
"torchvision==0.16.2+cu121",
"tqdm==4.66.2",
"trampoline==0.1.2",
"transformers==4.30.2",
"trimesh==4.1.5",
"typing-extensions==4.9.0",
"tzdata==2024.1",
"urllib3==2.2.1",
"uvicorn==0.27.1",
"vhacdx==0.0.5",
"wcwidth==0.2.13",
"webencodings==0.5.1",
"websockets==11.0.3",
"werkzeug==3.0.1",
"xatlas==0.0.9",
"xxhash==3.4.1",
"yacs==0.1.8",
"yapf==0.40.2",
"yarl==1.9.4",
"zipp==3.17.0"
]
}
### Console logs
```Shell
*** Error running postprocess_batch_list: C:\Work\forge\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py
Traceback (most recent call last):
File "C:\Work\forge\modules\scripts.py", line 859, in postprocess_batch_list
script.postprocess_batch_list(p, pp, *script_args, **kwargs)
File "C:\venv\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "C:\Work\forge\extensions-builtin\sd_forge_controlnet\scripts\controlnet.py", line 561, in postprocess_batch_list
self.process_unit_after_every_sampling(p, unit, self.current_params[i], pp, *args, **kwargs)
KeyError: 0
```
### Additional information
_No response_
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Reproduce the txt2img ControlNet Batch Folder flow, then start at extensions-builtin/sd_forge_controlnet/scripts/controlnet.py, especially get_input_data at line 182 and its call from process_unit_after_click_generate. Review the related hooks in modules/scripts.py and determine why cv2.imread returns no image for the folder input. Done means valid images in Batch Folder generate successfully without the reported exception.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- opencv, python
- Domain
- computer-vision, machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100