lllyasviel / lllyasviel/stable-diffusion-webui-forge

flux1-schnell-(ANY).gguf using this throws following error.

Open
#1,396 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
13k
Forks
1.7k
PR merge metrics
No merged PRs in 30d

Description

```
Loading Model: {'checkpoint_info': {'filename': 'E:\\Storage\\Apps\\AI_Geneartor\\stable-diffusion-webui-amdgpu-forge\\models\\Stable-diffusion\\flux1-schnell-Q4_1.gguf', 'hash': '00ccfa75'}, 'additional_modules': ['E:\\Storage\\Apps\\AI_Geneartor\\stable-diffusion-webui-amdgpu-forge\\models\\VAE\\ae.safetensors', 'E:\\Storage\\Apps\\AI_Geneartor\\stable-diffusion-webui-amdgpu-forge\\models\\text_encoder\\clip_l.safetensors', 'E:\\Storage\\Apps\\AI_Geneartor\\stable-diffusion-webui-amdgpu-forge\\models\\text_encoder\\t5xxl_fp8_e4m3fn.safetensors'], 'unet_storage_dtype': None}
Traceback (most recent call last):
File "E:\Storage\Apps\AI_Geneartor\stable-diffusion-webui-amdgpu-forge\modules_forge\main_thread.py", line 30, in work
self.result = self.func(*self.args, **self.kwargs)
File "E:\Storage\Apps\AI_Geneartor\stable-diffusion-webui-amdgpu-forge\modules\txt2img.py", line 110, in txt2img_function
processed = processing.process_images(p)
File "E:\Storage\Apps\AI_Geneartor\stable-diffusion-webui-amdgpu-forge\modules\processing.py", line 790, in process_images
p.sd_model, just_reloaded = forge_model_reload()
File "E:\Storage\Apps\AI_Geneartor\stable-diffusion-webui-amdgpu-forge\venv\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "E:\Storage\Apps\AI_Geneartor\stable-diffusion-webui-amdgpu-forge\modules\sd_models.py", line 501, in forge_model_reload
sd_model = forge_loader(state_dict, additional_state_dicts=additional_state_dicts)
File "E:\Storage\Apps\AI_Geneartor\stable-diffusion-webui-amdgpu-forge\venv\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "E:\Storage\Apps\AI_Geneartor\stable-diffusion-webui-amdgpu-forge\backend\loader.py", line 261, in forge_loader
component = load_huggingface_component(estimated_config, component_name, lib_name, cls_name, local_path, component_sd)
File "E:\Storage\Apps\AI_Geneartor\stable-diffusion-webui-amdgpu-forge\backend\loader.py", line 56, in load_huggingface_component
load_state_dict(model, state_dict, ignore_start='loss.')
File "E:\Storage\Apps\AI_Geneartor\stable-diffusion-webui-amdgpu-forge\backend\state_dict.py", line 5, in load_state_dict
missing, unexpected = model.load_state_dict(sd, strict=False)
File "E:\Storage\Apps\AI_Geneartor\stable-diffusion-webui-amdgpu-forge\venv\lib\site-packages\torch\nn\modules\module.py", line 2189, in load_state_dict
raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format(
RuntimeError: Error(s) in loading state_dict for IntegratedAutoencoderKL:
size mismatch for encoder.conv_out.weight: copying a param with shape torch.Size([8, 512, 3, 3]) from checkpoint, the shape in current model is torch.Size([32, 512, 3, 3]).
size mismatch for encoder.conv_out.bias: copying a param with shape torch.Size([8]) from checkpoint, the shape in current model is torch.Size([32]).
size mismatch for decoder.conv_in.weight: copying a param with shape torch.Size([512, 4, 3, 3]) from checkpoint, the shape in current model is torch.Size([512, 16, 3, 3]).
Error(s) in loading state_dict for IntegratedAutoencoderKL:
size mismatch for encoder.conv_out.weight: copying a param with shape torch.Size([8, 512, 3, 3]) from checkpoint, the shape in current model is torch.Size([32, 512, 3, 3]).
size mismatch for encoder.conv_out.bias: copying a param with shape torch.Size([8]) from checkpoint, the shape in current model is torch.Size([32]).
size mismatch for decoder.conv_in.weight: copying a param with shape torch.Size([512, 4, 3, 3]) from checkpoint, the shape in current model is torch.Size([512, 16, 3, 3]).

```

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the error with models/Stable-diffusion/flux1-schnell-Q4_1.gguf and the listed VAE and text encoder files. Read backend/loader.py, backend/state_dict.py, and the traceback entry points in modules/sd_models.py and modules/processing.py; done means the model loads without the IntegratedAutoencoderKL tensor-size mismatch.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.