kohya-ss / kohya-ss/sd-scripts

Add more arguments for Cosine_with_restarts scheduler

Open
#73 0 comments 1 reaction 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
7.2k
Forks
1.2k
Avg merge
11m
Merged PRs (30d)
2

Description

Please add some parameters in your finetuner, like Minimum and maximum learning rate, rate of increasing/decreasing learning rate per cycle, numbers of epochs per cycle and warmup steps per cycle, like in Aria1th's monkey patch
>https://github.com/aria1th/Hypernetwork-MonkeyPatch-Extension

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing the linked Aria1th Hypernetwork-MonkeyPatch-Extension and locating the Cosine_with_restarts scheduler and finetuner entry points in this repository. Compare the requested minimum and maximum learning rates, per-cycle rate changes, cycle epochs, and warmup steps with the reference behavior. Done means these parameters are supported and the scheduler behavior matches the requested configuration.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.