kohya-ss / kohya-ss/sd-scripts
*Possible important fixes for some issues with flux
- Dominant language
- Python
- Stars
- 7.2k
- Forks
- 1.2k
- Avg merge
- 11m
- Merged PRs (30d)
- 2
Description
1. is there something similar to logit normal? like the one in onetrainer?
2. Debiased noise estimation, Min SNR Support? do they work?
3. Noise offset? not sure if it works either.
4. Optional EMA, EMA decay?
5. Different learning rates for the t5 and clip L
6. Lokr training ( apparently it helps with concepts not getting bleed through)
Thank you for the work and support!
Hope at least some of these are possible in the near future.
Contributor guide
No contributing guide indexed for this repository
Research direction
Review the current Flux training support and compare it with the six requested areas: logit-normal sampling, debiased noise estimation, Min SNR, noise offset, EMA, separate T5 and CLIP learning rates, and LoKr training. Determine which items are already supported, which are feasible, and define a separate, testable scope for any accepted change.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100