alphacep / alphacep/vosk-api

lmrescore failure and missing Gr.fst when run the training/run.sh

Aperta
#1,668 3 commenti 0 reazioni 0 assegnatari Vedi su GitHub
Lingua principale
Jupyter Notebook
Stelle
15.1k
Fork
1.8k
Metriche di merge delle PR
Nessuna PR unita negli ultimi 30g

Descrizione

Hi, dear authors,

I followed the training recipe in the vosk-api/training folder, I did get a trained model, but the performance is not so good.
Also I found the following errors and some mismatch in model structures from the pretrained models. I wondered if there is something I did wrong.
I used the recent official kaldi repo and installed it with cuda on successfully.

1. in the decode stage, steps/lmrescore_const_arpa.sh would fail, and here is the log(maybe there needs to be a specfic version of kaldi?) But there is a WER result at last. I guess just the rescored version failed.
![截屏2024-11-28 19 05 28](https://github.com/user-attachments/assets/a37952df-f8fc-4a97-97ef-5784b2d3e9f3)

2. I intended to get a model structure similar to "vosk-model-en-us-0.22-lgraph", but there is some difference. this is my exp/chain/tdnn folder.
![截屏2024-11-28 19 09 14](https://github.com/user-attachments/assets/54b0a698-d609-4ee9-a56e-a0712ef497de)

- First, compared to the pretrained models, I got a HCLG.fst, but not a HCLr.fst and Gr.fst, supposed I need a runtime graph.
- Secondly, I don't find the model.conf file, I tried to collect all the params during training, but maybe not enough. So I just copied the one from "vosk-model-en-us-0.22-lgraph", it worked, but not sure it fits right into my own trained model.
- I map the exp/chain/extractor folder to ivector folder, not sure it works, but the files are similar.

3. From the results I got, I run the python script, test_simple.py, all the output words are upper case also not very precise(since I just run the demo run.sh, the training data couldn't be sufficient, so maybe this is possible, I can attach the audio if necessary, it's a good quality speech with decent pronunciation ), and I got a warning, runtime graphs are not supported, as I mentioned above.

So could you help with this? Am I missing some steps in training or there is some twist I should do after training?
Many thanks~

Guida per i contributori

Nessuna guida per i contributori indicizzata per questo repository

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.