huggingface / huggingface/diffusers

Whether lohaconfig is supported in the convert_state_dict_to_diffusers method

Open
#10,899 2 comments 0 reactions 0 assignees View on GitHub
stale
Dominant language
Python
Stars
34.5k
Forks
7.3k
Avg merge
3d 3h
Merged PRs (30d)
91

Description

In the train_text_to_image_lora.py file

unet_lora_config = LoraConfig(
r=cfg.rank,
lora_alpha=cfg.rank,
init_lora_weights="gaussian",
target_modules=["to_k", "to_q", "to_v", "to_out.0"],
)
modified to

unet_lora_config = LoHaConfig(
r=cfg.rank,
alpha=cfg.rank,
target_modules=["to_k", "to_q", "to_v", "to_out.0"],
),

unet_lora_state_dict = convert_state_dict_to_diffusers(
get_peft_model_state_dict(unwrapped_unet)
)
in this line, an error will occur. Please tell me how to modify it.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.