kohya-ss / kohya-ss/sd-scripts
Add more arguments for Cosine_with_restarts scheduler
- Dominant language
- Python
- Stars
- 7.2k
- Forks
- 1.2k
- Avg merge
- 11m
- Merged PRs (30d)
- 2
Description
Please add some parameters in your finetuner, like Minimum and maximum learning rate, rate of increasing/decreasing learning rate per cycle, numbers of epochs per cycle and warmup steps per cycle, like in Aria1th's monkey patch
>https://github.com/aria1th/Hypernetwork-MonkeyPatch-Extension
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reviewing the linked Aria1th Hypernetwork-MonkeyPatch-Extension and locating the Cosine_with_restarts scheduler and finetuner entry points in this repository. Compare the requested minimum and maximum learning rates, per-cycle rate changes, cycle epochs, and warmup steps with the reference behavior. Done means these parameters are supported and the scheduler behavior matches the requested configuration.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100