kohya-ss / kohya-ss/sd-scripts

*Possible important fixes for some issues with flux

Open
#1,584 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
7.2k
Forks
1.2k
Avg merge
11m
Merged PRs (30d)
2

Description

1. is there something similar to logit normal? like the one in onetrainer?

2. Debiased noise estimation, Min SNR Support? do they work?

3. Noise offset? not sure if it works either.

4. Optional EMA, EMA decay?

5. Different learning rates for the t5 and clip L

6. Lokr training ( apparently it helps with concepts not getting bleed through)

Thank you for the work and support!

Hope at least some of these are possible in the near future.

Contributor guide

No contributing guide indexed for this repository

Research direction

Review the current Flux training support and compare it with the six requested areas: logit-normal sampling, debiased noise estimation, Min SNR, noise offset, EMA, separate T5 and CLIP learning rates, and LoKr training. Determine which items are already supported, which are feasible, and define a separate, testable scope for any accepted change.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.