babysor / babysor/MockingBird

启动后第一次点击 synthesize and vocode 报错

Open
#563 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
36.9k
Forks
5.2k
PR merge metrics
No merged PRs in 30d

Description

执行python demo_toolbox.py -d .\samples 启动程序后,第一次点击synthesize and vocode按钮报错,之后就不报错了,不知道什么原因?
RuntimeError: Error(s) in loading state_dict for Tacotron:
size mismatch for encoder_proj.weight: copying a param with shape torch.Size([128, 512]) from checkpoint, the shape in current model is torch.Size([128, 1024]).
size mismatch for decoder.attn_rnn.weight_ih: copying a param with shape torch.Size([384, 768]) from checkpoint, the shape in current model is torch.Size([384, 1280]).
size mismatch for decoder.rnn_input.weight: copying a param with shape torch.Size([1024, 640]) from checkpoint, the shape in current model is torch.Size([1024, 1152]).
size mismatch for decoder.stop_proj.weight: copying a param with shape torch.Size([1, 1536]) from checkpoint, the shape in current model is torch.Size([1, 2048]).

Contributor guide

No contributing guide indexed for this repository

Research direction

Reproduce the first-click failure by running `python demo_toolbox.py -d .\samples` and using the “synthesize and vocode” button. Start with `demo_toolbox.py` and trace the Tacotron checkpoint-loading path; compare the checkpoint and current-model dimensions shown in the error. Done means the first click completes without the state-dict mismatch and later clicks still work.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
audio-video-rtc, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.