lllyasviel / lllyasviel/stable-diffusion-webui-forge

Not working on AMD card after trying a few things listed on here.

Open
#537 16 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
13k
Forks
1.7k
PR merge metrics
No merged PRs in 30d

Description

### Checklist

- [X] The issue exists after disabling all extensions
- [X] The issue exists on a clean installation of webui
- [ ] The issue is caused by an extension, but I believe it is caused by a bug in the webui
- [X] The issue exists in the current version of the webui
- [x] The issue has not been reported before recently
- [X] The issue has been reported before but has not been fixed yet

### What happened?

Trying to run forge with my 6750 XT, to no avail, tried:

-COMMANDLINE_ARGS= --directml --skip-torch-cuda-test --always-normal-vram --skip-version-check
-comment out all the @torch.inference_mode() (add # before them) on: \ldm_patched\modules\utils.py - line 407 \modules_forge\forge_loader.py - line 236, line 242
change "with torch.inference_mode():" for "with torch.no_grad():" on: \modules\processing.py - line 817

CPU and GPU seed gen, restarted my pc, nothing.
only using a single SDXL checkpoint.

the only thing I get as a result is:
typeerror: 'nonetype' object is not iterable

### Steps to reproduce the problem

AMD gpu..

### What should have happened?

should work from what I have seen on here

### What browsers do you use to access the UI ?

Mozilla Firefox

### Sysinfo

[sysinfo-2024-03-11-18-07.json](https://github.com/lllyasviel/stable-diffusion-webui-forge/files/14562816/sysinfo-2024-03-11-18-07.json)

### Console logs

```Shell
venv "G:\StableDiffed\stable-diffusion-webui-forge\venv\Scripts\Python.exe"
Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug 1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Version: f0.0.17v1.8.0rc-latest-276-g29be1da7
Commit hash: 29be1da7cf2b5dccfc70fbdd33eb35c56a31ffb7
Launching Web UI with arguments: --directml --skip-torch-cuda-test --always-normal-vram --skip-version-check
Using directml with device:
Total VRAM 1024 MB, total RAM 32672 MB
Set vram state to: NORMAL_VRAM
Device: privateuseone
VAE dtype: torch.float32
CUDA Stream Activated: False
Warning: caught exception 'Torch not compiled with CUDA enabled', memory monitor disabled
Using sub quadratic optimization for cross attention, if you have memory or speed issues try using: --attention-split
reading lora G:\StableDiffed\stable-diffusion-webui-forge\models\Lora\shark_tailv1.safetensors: UnicodeDecodeError
Traceback (most recent call last):
File "G:\StableDiffed\stable-diffusion-webui-forge\extensions-builtin\Lora\network.py", line 38, in __init__
self.metadata = cache.cached_data_for_file('safetensors-metadata', "lora/" + self.name, filename, read_metadata)
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\cache.py", line 114, in cached_data_for_file
value = func()
File "G:\StableDiffed\stable-diffusion-webui-forge\extensions-builtin\Lora\network.py", line 31, in read_metadata
metadata = sd_models.read_metadata_from_safetensors(filename)
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\sd_models.py", line 290, in read_metadata_from_safetensors
json_obj = json.loads(json_data)
File "C:\Users\User\AppData\Local\Programs\Python\Python310\lib\json\__init__.py", line 341, in loads
s = s.decode(detect_encoding(s), 'surrogatepass')
UnicodeDecodeError: 'utf-8' codec can't decode byte 0xac in position 121317: invalid start byte

ControlNet preprocessor location: G:\StableDiffed\stable-diffusion-webui-forge\models\ControlNetPreprocessor
Loading weights [d3ee23d452] from G:\StableDiffed\stable-diffusion-webui-forge\models\Stable-diffusion\autismmixSDXL_autismmixDPO.safetensors
2024-03-11 19:06:21,639 - ControlNet - INFO - ControlNet UI callback registered.
Running on local URL: http://127.0.0.1:7860

To create a public link, set `share=True` in `launch()`.
model_type EPS
UNet ADM Dimension 2816
Startup time: 11.7s (prepare environment: 1.0s, import torch: 3.8s, import gradio: 1.1s, setup paths: 1.0s, initialize shared: 0.1s, other imports: 0.5s, list SD models: 0.1s, load scripts: 2.9s, create ui: 0.6s, gradio launch: 0.5s).
Using split attention in VAE
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
Using split attention in VAE
extra {'cond_stage_model.clip_g.transformer.text_model.embeddings.position_ids', 'cond_stage_model.clip_l.text_projection', 'cond_stage_model.clip_l.logit_scale'}
loading stable diffusion model: NameError
Traceback (most recent call last):
File "G:\StableDiffed\stable-diffusion-webui-forge\launch.py", line 51, in
main()
File "G:\StableDiffed\stable-diffusion-webui-forge\launch.py", line 47, in main
start()
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\launch_utils.py", line 549, in start
main_thread.loop()
File "G:\StableDiffed\stable-diffusion-webui-forge\modules_forge\main_thread.py", line 37, in loop
task.work()
File "G:\StableDiffed\stable-diffusion-webui-forge\modules_forge\main_thread.py", line 26, in work
self.result = self.func(*self.args, **self.kwargs)
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\sd_models.py", line 509, in get_sd_model
load_model()
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\sd_models.py", line 585, in load_model
sd_model = forge_loader.load_model_for_a1111(timer=timer, checkpoint_info=checkpoint_info, state_dict=state_dict)
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "G:\StableDiffed\stable-diffusion-webui-forge\modules_forge\forge_loader.py", line 250, in load_model_for_a1111
sd_model.decode_first_stage = patched_decode_first_stage
NameError: name 'patched_decode_first_stage' is not defined

Stable diffusion model failed to load
Loading weights [d3ee23d452] from G:\StableDiffed\stable-diffusion-webui-forge\models\Stable-diffusion\autismmixSDXL_autismmixDPO.safetensors
model_type EPS
UNet ADM Dimension 2816
Using split attention in VAE
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
Using split attention in VAE
extra {'cond_stage_model.clip_g.transformer.text_model.embeddings.position_ids', 'cond_stage_model.clip_l.text_projection', 'cond_stage_model.clip_l.logit_scale'}
loading stable diffusion model: NameError
Traceback (most recent call last):
File "C:\Users\User\AppData\Local\Programs\Python\Python310\lib\threading.py", line 973, in _bootstrap
self._bootstrap_inner()
File "C:\Users\User\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
self.run()
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 807, in run
result = context.run(func, *args)
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\utils.py", line 707, in wrapper
response = f(*args, **kwargs)
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\ui.py", line 1178, in
update_image_cfg_scale_visibility = lambda: gr.update(visible=shared.sd_model and shared.sd_model.cond_stage_key == "edit")
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\shared_items.py", line 133, in sd_model
return modules.sd_models.model_data.get_sd_model()
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\sd_models.py", line 509, in get_sd_model
load_model()
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\sd_models.py", line 585, in load_model
sd_model = forge_loader.load_model_for_a1111(timer=timer, checkpoint_info=checkpoint_info, state_dict=state_dict)
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "G:\StableDiffed\stable-diffusion-webui-forge\modules_forge\forge_loader.py", line 250, in load_model_for_a1111
sd_model.decode_first_stage = patched_decode_first_stage
NameError: name 'patched_decode_first_stage' is not defined

Stable diffusion model failed to load
Loading weights [d3ee23d452] from G:\StableDiffed\stable-diffusion-webui-forge\models\Stable-diffusion\autismmixSDXL_autismmixDPO.safetensors
model_type EPS
UNet ADM Dimension 2816
Using split attention in VAE
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
Using split attention in VAE
extra {'cond_stage_model.clip_g.transformer.text_model.embeddings.position_ids', 'cond_stage_model.clip_l.text_projection', 'cond_stage_model.clip_l.logit_scale'}
loading stable diffusion model: NameError
Traceback (most recent call last):
File "C:\Users\User\AppData\Local\Programs\Python\Python310\lib\threading.py", line 973, in _bootstrap
self._bootstrap_inner()
File "C:\Users\User\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
self.run()
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 807, in run
result = context.run(func, *args)
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\utils.py", line 707, in wrapper
response = f(*args, **kwargs)
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 703, in pages_html
create_html()
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 699, in create_html
ui.pages_contents = [pg.create_html(ui.tabname) for pg in ui.stored_extra_pages]
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 699, in
ui.pages_contents = [pg.create_html(ui.tabname) for pg in ui.stored_extra_pages]
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 518, in create_html
self.items = {x["name"]: x for x in items_list}
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 518, in
self.items = {x["name"]: x for x in items_list}
File "G:\StableDiffed\stable-diffusion-webui-forge\extensions-builtin\Lora\ui_extra_networks_lora.py", line 82, in list_items
item = self.create_item(name, index)
File "G:\StableDiffed\stable-diffusion-webui-forge\extensions-builtin\Lora\ui_extra_networks_lora.py", line 69, in create_item
elif shared.sd_model.is_sdxl and sd_version != network.SdVersion.SDXL:
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\shared_items.py", line 133, in sd_model
return modules.sd_models.model_data.get_sd_model()
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\sd_models.py", line 509, in get_sd_model
load_model()
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\sd_models.py", line 585, in load_model
sd_model = forge_loader.load_model_for_a1111(timer=timer, checkpoint_info=checkpoint_info, state_dict=state_dict)
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "G:\StableDiffed\stable-diffusion-webui-forge\modules_forge\forge_loader.py", line 250, in load_model_for_a1111
sd_model.decode_first_stage = patched_decode_first_stage
NameError: name 'patched_decode_first_stage' is not defined

Stable diffusion model failed to load
Loading weights [d3ee23d452] from G:\StableDiffed\stable-diffusion-webui-forge\models\Stable-diffusion\autismmixSDXL_autismmixDPO.safetensors
Traceback (most recent call last):
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\routes.py", line 488, in run_predict
output = await app.get_blocks().process_api(
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1431, in process_api
result = await self.call_function(
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1103, in call_function
prediction = await anyio.to_thread.run_sync(
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\to_thread.py", line 33, in run_sync
return await get_asynclib().run_sync_in_worker_thread(
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 877, in run_sync_in_worker_thread
return await future
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 807, in run
result = context.run(func, *args)
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\utils.py", line 707, in wrapper
response = f(*args, **kwargs)
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 703, in pages_html
create_html()
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 699, in create_html
ui.pages_contents = [pg.create_html(ui.tabname) for pg in ui.stored_extra_pages]
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 699, in
ui.pages_contents = [pg.create_html(ui.tabname) for pg in ui.stored_extra_pages]
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 518, in create_html
self.items = {x["name"]: x for x in items_list}
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 518, in
self.items = {x["name"]: x for x in items_list}
File "G:\StableDiffed\stable-diffusion-webui-forge\extensions-builtin\Lora\ui_extra_networks_lora.py", line 82, in list_items
item = self.create_item(name, index)
File "G:\StableDiffed\stable-diffusion-webui-forge\extensions-builtin\Lora\ui_extra_networks_lora.py", line 69, in create_item
elif shared.sd_model.is_sdxl and sd_version != network.SdVersion.SDXL:
AttributeError: 'NoneType' object has no attribute 'is_sdxl'
model_type EPS
UNet ADM Dimension 2816
Using split attention in VAE
Working with z of shape (1, 4, 32, 32) = 4096 dimensions.
Using split attention in VAE
extra {'cond_stage_model.clip_g.transformer.text_model.embeddings.position_ids', 'cond_stage_model.clip_l.text_projection', 'cond_stage_model.clip_l.logit_scale'}
loading stable diffusion model: NameError
Traceback (most recent call last):
File "C:\Users\User\AppData\Local\Programs\Python\Python310\lib\threading.py", line 973, in _bootstrap
self._bootstrap_inner()
File "C:\Users\User\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
self.run()
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 807, in run
result = context.run(func, *args)
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\utils.py", line 707, in wrapper
response = f(*args, **kwargs)
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 703, in pages_html
create_html()
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 699, in create_html
ui.pages_contents = [pg.create_html(ui.tabname) for pg in ui.stored_extra_pages]
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 699, in
ui.pages_contents = [pg.create_html(ui.tabname) for pg in ui.stored_extra_pages]
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 518, in create_html
self.items = {x["name"]: x for x in items_list}
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 518, in
self.items = {x["name"]: x for x in items_list}
File "G:\StableDiffed\stable-diffusion-webui-forge\extensions-builtin\Lora\ui_extra_networks_lora.py", line 82, in list_items
item = self.create_item(name, index)
File "G:\StableDiffed\stable-diffusion-webui-forge\extensions-builtin\Lora\ui_extra_networks_lora.py", line 69, in create_item
elif shared.sd_model.is_sdxl and sd_version != network.SdVersion.SDXL:
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\shared_items.py", line 133, in sd_model
return modules.sd_models.model_data.get_sd_model()
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\sd_models.py", line 509, in get_sd_model
load_model()
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\sd_models.py", line 585, in load_model
sd_model = forge_loader.load_model_for_a1111(timer=timer, checkpoint_info=checkpoint_info, state_dict=state_dict)
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "G:\StableDiffed\stable-diffusion-webui-forge\modules_forge\forge_loader.py", line 250, in load_model_for_a1111
sd_model.decode_first_stage = patched_decode_first_stage
NameError: name 'patched_decode_first_stage' is not defined

Stable diffusion model failed to load
Traceback (most recent call last):
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\routes.py", line 488, in run_predict
output = await app.get_blocks().process_api(
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1431, in process_api
result = await self.call_function(
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\blocks.py", line 1103, in call_function
prediction = await anyio.to_thread.run_sync(
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\to_thread.py", line 33, in run_sync
return await get_asynclib().run_sync_in_worker_thread(
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 877, in run_sync_in_worker_thread
return await future
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\anyio\_backends\_asyncio.py", line 807, in run
result = context.run(func, *args)
File "G:\StableDiffed\stable-diffusion-webui-forge\venv\lib\site-packages\gradio\utils.py", line 707, in wrapper
response = f(*args, **kwargs)
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 703, in pages_html
create_html()
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 699, in create_html
ui.pages_contents = [pg.create_html(ui.tabname) for pg in ui.stored_extra_pages]
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 699, in
ui.pages_contents = [pg.create_html(ui.tabname) for pg in ui.stored_extra_pages]
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 518, in create_html
self.items = {x["name"]: x for x in items_list}
File "G:\StableDiffed\stable-diffusion-webui-forge\modules\ui_extra_networks.py", line 518, in
self.items = {x["name"]: x for x in items_list}
File "G:\StableDiffed\stable-diffusion-webui-forge\extensions-builtin\Lora\ui_extra_networks_lora.py", line 82, in list_items
item = self.create_item(name, index)
File "G:\StableDiffed\stable-diffusion-webui-forge\extensions-builtin\Lora\ui_extra_networks_lora.py", line 69, in create_item
elif shared.sd_model.is_sdxl and sd_version != network.SdVersion.SDXL:
AttributeError: 'NoneType' object has no attribute 'is_sdxl'
```

### Additional information

_No response_

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with modules_forge/forge_loader.py around line 250 and trace its call from modules/sd_models.py lines 509 and 585 while launching with the reported DirectML arguments. Reproduce the SDXL checkpoint-loading failure and verify that the model loads successfully without the reported NameError.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.