kohya-ss / kohya-ss/sd-scripts

Flux how to use the lora model with T5xxl trained

Open
#1,723 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
7.2k
Forks
1.2k
Avg merge
11m
Merged PRs (30d)
2

Description

I have a model trained with T5-xxl = True, which is a 827M model (rank=64). When I pass this model into the WebUI Forge, I see the following logs:
```
[LORA] Loaded /ai_model/dev/comfyui/models/loras/flux_with_te-step00000010.safetensors for KModel-UNet with 304 keys at weight 1.0 (skipped 0 keys) with on_the_fly = False
[LORA] Loaded /ai_model/dev/comfyui/models/loras/flux_with_te-step00000010.safetensors for KModel-CLIP with 240 keys at weight 1.0 (skipped 0 keys) with on_the_fly = False
```
Does this mean the T5 weights are not working at all? How can I properly use this LoRA?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the WebUI Forge load logs in the issue and compare the KModel-UNet and KModel-CLIP entries for the T5-xxl-trained LoRA. Determine from the project documentation or loading entry points whether these logs indicate T5 weights are applied and document the correct usage and expected loading behavior.

Written by the indexing model from the issue text.

Assessment

Domain
machine-learning
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.