RVC-Project / RVC-Project/Retrieval-based-Voice-Conversion-WebUI

What should be the config for 44.1 training?

Open
#2,056 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
38.4k
Forks
5.3k
PR merge metrics
No merged PRs in 30d

Description

Error:

  loss_mel = F.l1_loss(y_mel, y_hat_mel) * hps.train.c_mel
Process Process-1:
Traceback (most recent call last):
  File "C:\Users\X\Downloads\Applio\env\lib\multiprocessing\process.py", line 315, in _bootstrap
    self.run()
  File "C:\Users\X\Downloads\Applio\env\lib\multiprocessing\process.py", line 108, in run
    self._target(*self._args, **self._kwargs)
  File "C:\Users\X\Downloads\Applio\rvc\train\train.py", line 258, in run
    train_and_evaluate(
  File "C:\Users\X\Downloads\Applio\rvc\train\train.py", line 465, in train_and_evaluate
    loss_mel = F.l1_loss(y_mel, y_hat_mel) * hps.train.c_mel
  File "C:\Users\X\Downloads\Applio\env\lib\site-packages\torch\nn\functional.py", line 3297, in l1_loss
    expanded_input, expanded_target = torch.broadcast_tensors(input, target)
  File "C:\Users\X\Downloads\Applio\env\lib\site-packages\torch\functional.py", line 73, in broadcast_tensors
    return _VF.broadcast_tensors(tensors)  # type: ignore[attr-defined]
RuntimeError: The size of tensor a (23) must match the size of tensor b (13) at non-singleton dimension 2

Tested here https://github.com/IAHispano/Applio/commit/d55124378974e7756282659270c94912c4ce39f6 (full branch https://github.com/IAHispano/Applio/tree/exp-44k-training)

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start in rvc/train/train.py at lines 258 and 465, then compare the configuration and behavior in commit d55124378974e7756282659270c94912c4ce39f6 and the exp-44k-training branch. Reproduce the 44.1 training run and inspect the tensor shapes at the mel loss calculation. Done means identifying a compatible 44.1 kHz training configuration or documenting the required fix so training no longer raises the size mismatch.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
audio-video-rtc, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.