Comfy-Org / Comfy-Org/ComfyUI

OneTrainer lora format for ideogram4 ✨

Open
#14,477 0 comments 1 reaction 1 assignee Claimed by @alexisrolland View on GitHub
Feature
Dominant language
Python
Stars
133k
Forks
15.7k
Avg merge
1d 7h
Merged PRs (30d)
158

Description

### Feature Idea

OneTrainer just added Ideogram4 support, bringing with it split q k v loras!

Would be great if they could be supported.

Example lora:

https://huggingface.co/bertbobson/temp_stuff/blob/main/Bad.safetensors

if I rename the keys to match the expected comfyui naming scheme, these are not loaded per block:

```
[WARNING] lora key not loaded: diffusion_model.layers.0.attention.to_k.alpha
[WARNING] lora key not loaded: diffusion_model.layers.0.attention.to_k.lora_A.weight
[WARNING] lora key not loaded: diffusion_model.layers.0.attention.to_k.lora_B.weight
[WARNING] lora key not loaded: diffusion_model.layers.0.attention.to_out.0.alpha
[WARNING] lora key not loaded: diffusion_model.layers.0.attention.to_out.0.lora_A.weight
[WARNING] lora key not loaded: diffusion_model.layers.0.attention.to_out.0.lora_B.weight
[WARNING] lora key not loaded: diffusion_model.layers.0.attention.to_q.alpha
[WARNING] lora key not loaded: diffusion_model.layers.0.attention.to_q.lora_A.weight
[WARNING] lora key not loaded: diffusion_model.layers.0.attention.to_q.lora_B.weight
[WARNING] lora key not loaded: diffusion_model.layers.0.attention.to_v.alpha
[WARNING] lora key not loaded: diffusion_model.layers.0.attention.to_v.lora_A.weight
[WARNING] lora key not loaded: diffusion_model.layers.0.attention.to_v.lora_B.weight

```

### Existing Solutions

_No response_

### Other

I love diffusers

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.