alphacep / alphacep/vosk-api

Vosk Versus Pico Voice - A quick comparison.

Abierto
#909 2 comentarios 2 reacciones 0 asignados Ver en GitHub
Lenguaje dominante
Jupyter Notebook
Estrellas
15.1k
Forks
1.8k
Métricas de merge de PR
Sin PR fusionados en 30 d

Descripción

### Vosk Vs [Pico Voice (leopard)](https://github.com/Picovoice/leopard)

**Models Used:**
Vosk Model: [En-US 0.22](https://alphacephei.com/vosk/models/vosk-model-en-us-0.22.zip)
Pico Voice Model: En-Inbuilt (needs access-key which can be obtained by logging in to [Pico Voice Console](https://console.picovoice.ai/login)).

**Procedure:**
I wished to compare Vosk with another highly boasted ASR project called Picovoice (leopard) but this time I wanted to use a
simple file with less audio complexity as compared to my earlier comparison of #892. Plus video is of short duration... i.e.[ trailer 5 of Batman 2022](https://www.mediafire.com/file/3jvqbkum9ni2y0n/The_Batman_Trailer_5.mkv/file) containing better stereo audio in PCM format (2300kb/s at 48 KHZ).

Procedure was same as in #892 except spleeter was not used ....& audio file was simple (with no US slangs, bad words etc.) .......but it definitely consists of low & different voice pitches.

**Results:**
Pico unprocessed

WER: 62.162% ( 161 / 259)
WRR: 39.382% ( 102 / 259)

Pico processed

WER: 61.776% ( 160 / 259)
WRR: 40.154% ( 104 / 259)

Vosk unprocessed

WER: 111.446% ( 185 / 166)
WRR: 4.819% ( 8 / 166)

Vosk processed

WER: 62.348% ( 154 / 247)
WRR: 37.652% ( 93 / 247)

SER (Sentence error rate was again 100% in both the cases).

**Conclusion:**
Pico Voice does outperform Vosk in scores but other important factors to be considered:

1) Pico Voice only allows free usage of 360000 seconds per month...one needs access-key to be obtained online.Although the process seems to be offline but the key needs to be authenticated online.
2) Only english model is present.
3) Pico Voice also allows Speech-to-Text models with custom vocabularies you can add new words with custom pronunciations to fine tune the model (smart & practical way to increase efficiency).
4) Processing Vosk with spell check ...brings it's efficiency in par to Pico Voice.

**Files:**

_Originals:_
Original trailer can be downloaded from the link described in procedure for your analysis.
Original SRT obtained from youtube ...basic processing carried out using notepad++ (as in #892)
*1) [base.txt](https://github.com/alphacep/vosk-api/files/8402952/base.txt)
2) [pico.txt](https://github.com/alphacep/vosk-api/files/8402955/pico.txt)
*3) [vosk.txt](https://github.com/alphacep/vosk-api/files/8402956/vosk.txt)

* Please rename base.txt & vosk.txt to base.srt & vosk.srt as github does not allow srt file uploads.

_Processed (spell correction)_
1) [base.txt](https://github.com/alphacep/vosk-api/files/8402961/base.txt)
2) [pico.txt](https://github.com/alphacep/vosk-api/files/8402962/pico.txt)
3) [vosk.txt](https://github.com/alphacep/vosk-api/files/8402963/vosk.txt)

Enjoy!

Guía de contribución

No hay ninguna guía de contribución indexada para este repositorio

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.