huggingface / huggingface/candle

Whisper microphone example outputs gibberish

Open
#2,182 6 comments 1 reaction 0 assignees View on GitHub
Dominant language
Rust
Stars
21k
Forks
1.8k
Avg merge
16h 42m
Merged PRs (30d)
25

Description

I am trying to get the Candle Whisper microphone example to work but to no avail.

First, I encountered an issue related to the microphone being repeatedly reacquired, which causes pretty weird behavior on Linux. It turns out lavafroth on GitHub already submitted a PR (https://github.com/huggingface/candle/pull/1864).

However, even with those changes, I am getting gibberish out. For example, here's the output when I say, "Testing... One, two, three."

Perhaps the buffers are not managed correctly, but I don't understand the code enough (yet) to see what might be going on there.

```text
Transcribing audio...
language_token: None
0.0s -- 3.3s: you
1.0s -- 16.4s: .
2.0s -- 38.3s: S***
2.0s -- 38.3s: you
3.0s -- 77.9s: this this thing this thing this thing
3.0s -- 77.9s: testing one two three
4.0s -- 131.2s: this this thing this thing this thing
4.0s -- 131.2s: testing 123 testing 123 123 testing 123 123 testing 123 123
4.0s -- 131.2s: testing 1 2 3
5.0s -- 213.3s: this this thing this thing this thing
5.0s -- 213.3s: testing 123 testing 123 123 testing 123 123 testing 123 123
5.0s -- 213.3s: Testing 123 123 Testing 123 123 Testing 123 123 Testing 123 123
5.0s -- 213.3s: testing 123123
6.0s -- 298.7s: 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1, 2, 3, 1,
6.0s -- 298.7s: testing 123 123 testing 123 123 testing 123 123
6.0s -- 298.7s: Testing 123 123 Testing 123 123 Testing 123 123
6.0s -- 298.7s: testing 123123 testing 123123
6.0s -- 298.7s: testing 123 123 testing 123 123
6.0s -- 298.7s: you
7.0s -- 570.1s: testing 123123
7.0s -- 570.1s: testing 123 123
7.0s -- 570.1s: testing 123 123
```

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.