alphacep / alphacep/vosk-api

Vosk Versus Pico Voice - A quick comparison.

オープン
#909 コメント 2 件 リアクション 2 件 担当者 0 名 GitHub で見る
主要言語
Jupyter Notebook
スター
15.1k
フォーク
1.8k
PR マージ指標
30日以内にマージされた PR はありません

説明

### Vosk Vs [Pico Voice (leopard)](https://github.com/Picovoice/leopard)

**Models Used:**
Vosk Model: [En-US 0.22](https://alphacephei.com/vosk/models/vosk-model-en-us-0.22.zip)
Pico Voice Model: En-Inbuilt (needs access-key which can be obtained by logging in to [Pico Voice Console](https://console.picovoice.ai/login)).

**Procedure:**
I wished to compare Vosk with another highly boasted ASR project called Picovoice (leopard) but this time I wanted to use a
simple file with less audio complexity as compared to my earlier comparison of #892. Plus video is of short duration... i.e.[ trailer 5 of Batman 2022](https://www.mediafire.com/file/3jvqbkum9ni2y0n/The_Batman_Trailer_5.mkv/file) containing better stereo audio in PCM format (2300kb/s at 48 KHZ).

Procedure was same as in #892 except spleeter was not used ....& audio file was simple (with no US slangs, bad words etc.) .......but it definitely consists of low & different voice pitches.

**Results:**
Pico unprocessed

WER: 62.162% ( 161 / 259)
WRR: 39.382% ( 102 / 259)

Pico processed

WER: 61.776% ( 160 / 259)
WRR: 40.154% ( 104 / 259)

Vosk unprocessed

WER: 111.446% ( 185 / 166)
WRR: 4.819% ( 8 / 166)

Vosk processed

WER: 62.348% ( 154 / 247)
WRR: 37.652% ( 93 / 247)

SER (Sentence error rate was again 100% in both the cases).

**Conclusion:**
Pico Voice does outperform Vosk in scores but other important factors to be considered:

1) Pico Voice only allows free usage of 360000 seconds per month...one needs access-key to be obtained online.Although the process seems to be offline but the key needs to be authenticated online.
2) Only english model is present.
3) Pico Voice also allows Speech-to-Text models with custom vocabularies you can add new words with custom pronunciations to fine tune the model (smart & practical way to increase efficiency).
4) Processing Vosk with spell check ...brings it's efficiency in par to Pico Voice.

**Files:**

_Originals:_
Original trailer can be downloaded from the link described in procedure for your analysis.
Original SRT obtained from youtube ...basic processing carried out using notepad++ (as in #892)
*1) [base.txt](https://github.com/alphacep/vosk-api/files/8402952/base.txt)
2) [pico.txt](https://github.com/alphacep/vosk-api/files/8402955/pico.txt)
*3) [vosk.txt](https://github.com/alphacep/vosk-api/files/8402956/vosk.txt)

* Please rename base.txt & vosk.txt to base.srt & vosk.srt as github does not allow srt file uploads.

_Processed (spell correction)_
1) [base.txt](https://github.com/alphacep/vosk-api/files/8402961/base.txt)
2) [pico.txt](https://github.com/alphacep/vosk-api/files/8402962/pico.txt)
3) [vosk.txt](https://github.com/alphacep/vosk-api/files/8402963/vosk.txt)

Enjoy!

コントリビューションガイド

このリポジトリのコントリビューションガイドは索引されていません

評価

この issue はまだ評価されていません。

新しい issue をメールで受け取る

初心者向けの GitHub issue を短くまとめたダイジェスト。