SWivid / SWivid/F5-TTS

text normalizer

Open
#951 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement
Dominant language
Python
Stars
15.3k
Forks
2.2k
PR merge metrics
No merged PRs in 30d

Description

Checks
  • This template is only for feature request.
  • I have thoroughly reviewed the project documentation but couldn't find any relevant information that meets my needs.
  • I have searched for existing issues, including closed ones, and found not discussion yet.
  • I am using English to submit this issue to facilitate community communication.
1. Is this request related to a challenge you're experiencing? Tell us your story.

The fine-tuned models have various problems, which could be eliminated by a simple adjustment and normalization of the gen_text. These problems are the following (in the case of Hungarian, but I think also in the fine-tuned models of other languages).
1, the model does not pronounce numbers
2, the pronunciation of capital letters is problematic due to the lower occurrence in the training dataset
3, the pronunciation of some foreign language words may need adjustment
4, special characters like & # @ % ... all need phonetic transcription
5, time, date issues
...

2. What is your suggested solution?

The infer scripts should have a possibility to call the normalizer optimized for their own language into the gen_text channel, before the infer step.

for example there is my hungarian normalizer:
https://github.com/sarpba/F5-TTS_hun/tree/main/src/f5_tts/infer/normalisers/hun

3. Additional context or comments

No response

4. Can you help us with this feature?
  • I am interested in contributing to this feature.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with the infer scripts and trace how gen_text is passed into inference. Review the linked Hungarian normalizer as the example; done means a language-specific normalizer can be selected before inference and addresses numbers, capitalization, foreign words, special characters, and dates or times.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.