text normalizer
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 15.3k
- Forks
- 2.2k
- PR merge metrics
- No merged PRs in 30d
Description
Checks
- This template is only for feature request.
- I have thoroughly reviewed the project documentation but couldn't find any relevant information that meets my needs.
- I have searched for existing issues, including closed ones, and found not discussion yet.
- I am using English to submit this issue to facilitate community communication.
1. Is this request related to a challenge you're experiencing? Tell us your story.
The fine-tuned models have various problems, which could be eliminated by a simple adjustment and normalization of the gen_text. These problems are the following (in the case of Hungarian, but I think also in the fine-tuned models of other languages).
1, the model does not pronounce numbers
2, the pronunciation of capital letters is problematic due to the lower occurrence in the training dataset
3, the pronunciation of some foreign language words may need adjustment
4, special characters like & # @ % ... all need phonetic transcription
5, time, date issues
...
2. What is your suggested solution?
The infer scripts should have a possibility to call the normalizer optimized for their own language into the gen_text channel, before the infer step.
for example there is my hungarian normalizer:
https://github.com/sarpba/F5-TTS_hun/tree/main/src/f5_tts/infer/normalisers/hun
3. Additional context or comments
No response
4. Can you help us with this feature?
- I am interested in contributing to this feature.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the infer scripts and trace how gen_text is passed into inference. Review the linked Hungarian normalizer as the example; done means a language-specific normalizer can be selected before inference and addresses numbers, capitalization, foreign words, special characters, and dates or times.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 30/100