RVC-Project / RVC-Project/Retrieval-based-Voice-Conversion-WebUI

Model Inference Error on Transform

Open
#1,358 3 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

following up
Dominant language
Python
Stars
38.4k
Forks
5.3k
PR merge metrics
No merged PRs in 30d

Description

I trained the model with rmvpe-gpu through colab without GUI which is linked to my Google Drive.
I got these files in log folder

1- D_2333333.pth (~857 MB)
2- G_2333333.pth (~435 MB)
3- trained_IVF2593_Flat_nprobe_1_My-Model_v2.index (~8 MB)

4- added_IVF2593_Flat_nprobe_1_My-Model_v2.index (~ 320 MB)

So which one I have to use as transform in Model Inference.

Lastly If I Use GUI to download the Model by connecting to GDrive and try to use Model Inference then I am getting this error

2023-10-03 01:21:19 | WARNING | infer.modules.vc.modules | Traceback (most recent call last):
File "/content/drive/MyDrive/project-main/infer/modules/vc/modules.py", line 191, in vc_single
audio_opt = self.pipeline.pipeline(
File "/content/drive/MyDrive/project-main/infer/modules/vc/pipeline.py", line 410, in pipeline
self.vc(
File "/content/drive/MyDrive/project-main/infer/modules/vc/pipeline.py", line 238, in vc
npy = np.sum(big_npy[ix] * np.expand_dims(weight, axis=2), axis=1)
IndexError: index -1 is out of bounds for axis 0 with size 0

Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-packages/gradio/queueing.py", line 388, in call_prediction
output = await route_utils.call_process_api(
File "/usr/local/lib/python3.10/dist-packages/gradio/route_utils.py", line 219, in call_process_api
output = await app.get_blocks().process_api(
File "/usr/local/lib/python3.10/dist-packages/gradio/blocks.py", line 1440, in process_api
data = self.postprocess_data(fn_index, result["prediction"], state)
File "/usr/local/lib/python3.10/dist-packages/gradio/blocks.py", line 1341, in postprocess_data
prediction_value = block.postprocess(prediction_value)
File "/usr/local/lib/python3.10/dist-packages/gradio/components/audio.py", line 349, in postprocess
file_path = self.audio_to_temp_file(
File "/usr/local/lib/python3.10/dist-packages/gradio/components/base.py", line 325, in audio_to_temp_file
temp_dir = Path(self.DEFAULT_TEMP_DIR) / self.hash_bytes(data.tobytes())
AttributeError: 'NoneType' object has no attribute 'tobytes'

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Read infer/modules/vc/modules.py around vc_single and infer/modules/vc/pipeline.py around vc and pipeline, then reproduce the Model Inference path with the listed .pth and .index files. Done means establishing which model and index inputs are expected and obtaining a non-error audio result instead of the shown IndexError and NoneType failure.

Written by the indexing model from the issue text.

Assessment

Tech stack
numpy, python
Domain
audio-video-rtc, machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
18/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.