kohya-ss / kohya-ss/sd-scripts

Custom LR schedulers give an error during training

Open
#814 13 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
7.2k
Forks
1.2k
Avg merge
11m
Merged PRs (30d)
2

Description

My friend used Kohya's scripts to import custom schedulers like CosineAnnealingWarmRestarts from PyTorch directly, but they give an error. Below is a file with error text and what parameters were used.
[ValueError.txt](https://github.com/kohya-ss/sd-scripts/files/12569720/ValueError.txt)
![image_2023-09-10_20-27-59](https://github.com/kohya-ss/sd-scripts/assets/63471841/687ea0ed-53d4-4880-a3e3-ef39d809249b)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the attached ValueError.txt and the parameters shown in the issue image, then trace the training path that loads custom PyTorch schedulers such as CosineAnnealingWarmRestarts. Reproduce the reported error with those settings and identify the scheduler-loading entry point. Done means custom schedulers can be imported and used during training without the reported ValueError.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.