huggingface / huggingface/diffusers
Whether lohaconfig is supported in the convert_state_dict_to_diffusers method
Open
stale
- Dominant language
- Python
- Stars
- 34.5k
- Forks
- 7.3k
- Avg merge
- 3d 3h
- Merged PRs (30d)
- 91
Description
In the train_text_to_image_lora.py file
unet_lora_config = LoraConfig(
r=cfg.rank,
lora_alpha=cfg.rank,
init_lora_weights="gaussian",
target_modules=["to_k", "to_q", "to_v", "to_out.0"],
)
modified to
unet_lora_config = LoHaConfig(
r=cfg.rank,
alpha=cfg.rank,
target_modules=["to_k", "to_q", "to_v", "to_out.0"],
),
unet_lora_state_dict = convert_state_dict_to_diffusers(
get_peft_model_state_dict(unwrapped_unet)
)
in this line, an error will occur. Please tell me how to modify it.
Contributor guide
Assessment
This issue has not been assessed yet.