EveryVoiceTTS / EveryVoiceTTS/EveryVoice

We should be able to add an inference-level g2p processing script without mucking around in the model

Open
#862 1 comment 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
45
Forks
4
Avg merge
1d 2h
Merged PRs (30d)
14

Description

### Description & Motivation

Here's a situation where:

a) a dataset filelist already contains pre-tokenized phones. First thing is we should better support this.
b) I trained a model using the pre-tokenized phones
c) for inference, we need to add the g2p engine that made these phones, but the engines are defined in the checkpoint

Basically, I think there needs to be some way to hook into the demo or synthesize at inference time, or update the config more easily

Contributor guide

Open the contributing guide

Research direction

Start by tracing the demo and synthesize inference paths described in the issue, along with how checkpoint-defined G2P engines and pre-tokenized phones are currently handled. The work is done when inference can select or provide a G2P engine externally and support pre-tokenized phone filelists without modifying the model.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
audio-video-rtc, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.