RVC-Project / RVC-Project/Retrieval-based-Voice-Conversion-WebUI
What should be the config for 44.1 training?
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 38.4k
- Forks
- 5.3k
- PR merge metrics
- No merged PRs in 30d
Description
Error:
loss_mel = F.l1_loss(y_mel, y_hat_mel) * hps.train.c_mel
Process Process-1:
Traceback (most recent call last):
File "C:\Users\X\Downloads\Applio\env\lib\multiprocessing\process.py", line 315, in _bootstrap
self.run()
File "C:\Users\X\Downloads\Applio\env\lib\multiprocessing\process.py", line 108, in run
self._target(*self._args, **self._kwargs)
File "C:\Users\X\Downloads\Applio\rvc\train\train.py", line 258, in run
train_and_evaluate(
File "C:\Users\X\Downloads\Applio\rvc\train\train.py", line 465, in train_and_evaluate
loss_mel = F.l1_loss(y_mel, y_hat_mel) * hps.train.c_mel
File "C:\Users\X\Downloads\Applio\env\lib\site-packages\torch\nn\functional.py", line 3297, in l1_loss
expanded_input, expanded_target = torch.broadcast_tensors(input, target)
File "C:\Users\X\Downloads\Applio\env\lib\site-packages\torch\functional.py", line 73, in broadcast_tensors
return _VF.broadcast_tensors(tensors) # type: ignore[attr-defined]
RuntimeError: The size of tensor a (23) must match the size of tensor b (13) at non-singleton dimension 2
Tested here https://github.com/IAHispano/Applio/commit/d55124378974e7756282659270c94912c4ce39f6 (full branch https://github.com/IAHispano/Applio/tree/exp-44k-training)
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start in rvc/train/train.py at lines 258 and 465, then compare the configuration and behavior in commit d55124378974e7756282659270c94912c4ce39f6 and the exp-44k-training branch. Reproduce the 44.1 training run and inspect the tensor shapes at the mel loss calculation. Done means identifying a compatible 44.1 kHz training configuration or documenting the required fix so training no longer raises the size mismatch.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- audio-video-rtc, machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100