alphacep / alphacep/vosk-api

First part of text returned on some lines missing using vosk-model-ja-0.22

Đang mở
#1,133 6 bình luận 0 reaction 0 người được giao Xem trên GitHub
Ngôn ngữ chính
Jupyter Notebook
Star
15.1k
Fork
1.8k
Chỉ số merge pull request
Không có pull request nào được merge trong 30 ngày

Mô tả

I'm using the vosk integration in SubtitleEdit (current 3.6.7). Basically, it works very well.
But I've found one issue.

I noticed when doing audio to text using Japanese big model (vosk-model-ja-0.22), text for the first part of some spoken lines will be missing. Maybe once in 20 lines or so.
Audio is clear enough in these cases, so I think vosk should have picked something up.
It usually happens in the first part of a spoken phrase. Text elsewhere basically seems to be recognized well.

I reported this issue with SubtitleEdit on [https://github.com/SubtitleEdit/subtitleedit/issues/6171] "First part of text returned on some lines missing in Japanese audio to text #6171"
Conclusion there was that it's a vosk issue.
So I want to ask about it here.

Then, I noticed something on different samples exhibiting the same problem. The above problem occurred if the full audio sample (~45 min.) was processed.
But when I clipped ~30 sec. of audio around the problem lines, and then ran vosk on them with SE, all the text was recognized. You can see the difference below:

Clip 1:
full ~45 min. audio processed:
![ep03 clip 1243 full mkv waveform](https://user-images.githubusercontent.com/102390147/188226604-5cd9bc62-3cde-4d88-96f5-4da91c1c3f03.png)

30 sec. audio clip processed:
![ep03 clip 1243 short mkv waveform](https://user-images.githubusercontent.com/102390147/188226702-0f97bd72-963e-4144-9af8-dc219b02b66f.png)

Clip 2:
full ~45 min. audio processed:
![ep03 clip 1749 full mkv waveform](https://user-images.githubusercontent.com/102390147/188226796-df5e4ef9-4b5b-4259-92e6-aefef750a4f8.png)

30 sec. audio clip processed:

![ep03 clip 1749 short mkv waveform](https://user-images.githubusercontent.com/102390147/188226844-06f51eb3-6851-4370-8360-30e907b29927.png)

So I wonder if the sample length has any bearing on the text result. Or some other explanation?
It would be helpful if these lines could be complete.

Hướng dẫn đóng góp

Chưa lập chỉ mục được hướng dẫn đóng góp cho kho mã nguồn này

Đánh giá

Issue này chưa được đánh giá.

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.