babysor / babysor/MockingBird

ValueError("loaded state dict contains a parameter group " 使用別人的訓練合成器延續訓練下去都會出錯。

Open
#813 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
36.9k
Forks
5.2k
PR merge metrics
No merged PRs in 30d

Description

D:\MockingBird-0.0.1\MockingBird-0.0.1>python synthesizer_train.py CZC D:\Down\Ai\SV2TTS\synthesizer
Arguments:
run_id: CZC
syn_dir: D:\Down\Ai\SV2TTS\synthesizer
models_dir: synthesizer/saved_models/
save_every: 1000
backup_every: 25000
log_every: 200
force_restart: False
hparams:

Checkpoint path: synthesizer\saved_models\CZC\CZC.pt
Loading training data from: D:\Down\Ai\SV2TTS\synthesizer\train.txt
Using model: Tacotron
Using device: cuda

Initialising Tacotron Model...

Trainable Parameters: 31.948M

Loading weights at synthesizer\saved_models\CZC\CZC.pt
Traceback (most recent call last):
File "D:\MockingBird-0.0.1\MockingBird-0.0.1\synthesizer_train.py", line 37, in
train(**vars(args))
File "D:\MockingBird-0.0.1\MockingBird-0.0.1\synthesizer\train.py", line 114, in train
model.load(weights_fpath, optimizer)
File "D:\MockingBird-0.0.1\MockingBird-0.0.1\synthesizer\models\tacotron.py", line 526, in load
optimizer.load_state_dict(checkpoint["optimizer_state"])
File "C:\Users\chen7\AppData\Local\Programs\Python\Python39\lib\site-packages\torch\optim\optimizer.py", line 201, in load_state_dict
raise ValueError("loaded state dict contains a parameter group "
ValueError: loaded state dict contains a parameter group that doesn't match the size of optimizer's group

已參考#209 #37 每個訓練合成器也都試過了不是出現不匹配就是出現RuntimeError: Error(s) in loading state_dict for Tacotron
V.0.0.1跟新的兩個版本也都用過,都是一樣不行

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with synthesizer/models/tacotron.py at model.load and synthesizer/train.py around model.load(weights_fpath, optimizer), using synthesizer_train.py and the checkpoint path shown to reproduce the failure. Compare the checkpoint's optimizer_state with the current model and optimizer; done means continuation training loads successfully or the incompatibility is reported clearly.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.