kohya-ss / kohya-ss/sd-scripts

ValueError: loaded state dict contains a parameter group that doesn't match the size of optimizer's group

Open
#378 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
7.2k
Forks
1.2k
Avg merge
11m
Merged PRs (30d)
2

Description

Hi

I killed my training and launch a resume from the last checkpoint.
I did that before without issue (to add more images in the training) but this time I got this error:

File "E:\kohya\venv\lib\site-packages\bitsandbytes\optim\optimizer.py", line 149, in load_state_dict
raise ValueError(
ValueError: loaded state dict contains a parameter group that doesn't match the size of optimizer's group

I don't understand why.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing resume training from the last checkpoint and inspect the traceback at bitsandbytes/optim/optimizer.py line 149. Compare the saved optimizer parameter groups with those created for the resumed run, then document the cause and verify that resuming succeeds without the mismatch.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.