MoonInTheRiver / MoonInTheRiver/DiffSinger
How to inference on other <midi, text> files using the opencpop phone_set.json?
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 4.9k
- Forks
- 826
- PR merge metrics
- No merged PRs in 30d
Description
Hi, thanks for the great work!
I want to inference on my own <midi, text> files. I generated the corresponding meta.json and tried to binarize it. But the binarizer can only generate phone_set.json based on the input files, which will be incompatible with the pretrained checkpoint (since it was pretrained on opencpop with opencpop phone_set.json). A solution is to preprocess the customized testset with the original opencpop meta.json to obtain the full phone_set.json (i.e., the same phoneme dict). However, it is too inconvenient to do that thing.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the binarizer and the generation of phone_set.json from meta.json; compare the custom test-set path with the Opencpop phone_set.json expected by the pretrained checkpoint. Done means custom MIDI and text files can be prepared for inference without first processing the original Opencpop meta.json.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100