huggingface / huggingface/diffusers

Error in loading Lora

Offen
#11,224 6 Kommentare 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
bug lora stale
Vorherrschende Sprache
Python
Sterne
34.5k
Forks
7.3k
Ø Merge
3 T. 3 Std.
Gemergte PRs (30 T.)
91

Beschreibung

### Describe the bug

`lora_unet_label_emb_0_0.alpha` not supported error. I have uploaded the model on hugging face. Error appears on `load_lora_weights()` function

### Reproduction

```

from diffusers import DiffusionPipeline

pipe = DiffusionPipeline.from_pretrained("stabilityai/stable-diffusion-xl-base-1.0")
pipe.load_lora_weights("artemonlysuno/sdxl-lora-neutral1")

prompt = "abstract portrait of 1girl,undefined gender,fragmented visual style,red and black color palette,evokes feelings of rebellion,passion,and freedom,blurred boundaries,high resolution,aesthetic,"
image = pipe(prompt).images[0]
```

### Logs

```shell
Traceback (most recent call last):
File "/home/user/rw/Oleg/sd-base-api/test_lora.py", line 5, in
pipe.load_lora_weights("artemonlysuno/sdxl-lora-neutral1")
File "/home/user/anaconda3/envs/3.7/lib/python3.12/site-packages/diffusers/loaders/lora_pipeline.py", line 543, in load_lora_weights
state_dict, network_alphas = self.lora_state_dict(
^^^^^^^^^^^^^^^^^^^^^
File "/home/user/anaconda3/envs/3.7/lib/python3.12/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn
return fn(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^
File "/home/user/anaconda3/envs/3.7/lib/python3.12/site-packages/diffusers/loaders/lora_pipeline.py", line 698, in lora_state_dict
state_dict = _maybe_map_sgm_blocks_to_diffusers(state_dict, unet_config)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/user/anaconda3/envs/3.7/lib/python3.12/site-packages/diffusers/loaders/lora_conversion_utils.py", line 59, in _maybe_map_sgm_blocks_to_diffusers
raise ValueError(f"Checkpoint not supported because layer {layer} not supported.")
ValueError: Checkpoint not supported because layer lora_unet_label_emb_0_0.alpha not supported.
```

### System Info

Diffusers version: Version: 0.33.0.dev0
Python: 3.12.9

### Who can help?

@sayakpaul

Beitragsleitfaden

Beitragsleitfaden öffnen

Rechercherichtung

Start with _maybe_map_sgm_blocks_to_diffusers in src/diffusers/loaders/lora_conversion_utils.py, called from lora_state_dict in src/diffusers/loaders/lora_pipeline.py. Reproduce the failure with the provided pipeline and model, then determine how the lora_unet_label_emb_0_0.alpha layer should be handled; done means the checkpoint loads and the example generates an image.

Vom Indexierungsmodell aus dem Issue-Text verfasst.

Bewertung

Tech-Stack
huggingface, python, pytorch
Bereich
machine-learning
Issue-Typ
Bug
Schwierigkeit
3/5
Geschätzter Aufwand
1-2 Tage
Aktivitätsstatus
Veraltet
Klarheit
Größtenteils klar
Anfängerfreundlichkeit
42/100

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.