alphacep / alphacep/vosk-api

Recogniser with grammar: German and Spanish model does hardly ever produce unknown

Open
#1,017 14 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
15.1k
Forks
1.8k
PR merge metrics
No merged PRs in 30d

Description

With the small English model, the recognizers with grammar behave as expected: `[unk]` is recognized if a sentence is spoken that is clearly something different from what is specified in the grammar. However, with the small German and Spanish models [1], the recognizers do hardly ever return `[unk]` when a sentence is spoken, even if it has clearly nothing to do with the specified grammar. It looks to me like the problem is that **the recognizer gives immediately back some result without analyzing the whole word group (even though there are no silences between the words)**.

For example, I said `"was möchtest du als nachtes tun"` and analyzed it with a recognizer with the following grammar: `["terminus", "punkt", "klein", "ausruf", "frage", "doppelpunkt", "zurück", "sprache", "komma", "vor", "gross", "paragraf", "buchstaben", "ziffern", "strichpunkt", "[unk]"]`. The recognizer switched three times the partial result (from `"buchstaben"` to `"gross"` to `strichpunkt`) and then gave back the the result `"gross"`, after having processed only the beginning of the word group (probably about 20%), despite absence of silence between the words of the spoken sentence.

@nshmyrev , how can one avoid that the recognizer gives back results without analyzing the whole word group?

Thanks!!

[1] "vosk-model-small-de-0.15" and "vosk-model-small-es-0.22"

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.