kohya-ss / kohya-ss/sd-scripts
ValueError: loaded state dict contains a parameter group that doesn't match the size of optimizer's group
- Dominant language
- Python
- Stars
- 7.2k
- Forks
- 1.2k
- Avg merge
- 11m
- Merged PRs (30d)
- 2
Description
Hi
I killed my training and launch a resume from the last checkpoint.
I did that before without issue (to add more images in the training) but this time I got this error:
File "E:\kohya\venv\lib\site-packages\bitsandbytes\optim\optimizer.py", line 149, in load_state_dict
raise ValueError(
ValueError: loaded state dict contains a parameter group that doesn't match the size of optimizer's group
I don't understand why.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reproducing resume training from the last checkpoint and inspect the traceback at bitsandbytes/optim/optimizer.py line 149. Compare the saved optimizer parameter groups with those created for the resumed run, then document the cause and verify that resuming succeeds without the mismatch.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100