JacobLinCool / JacobLinCool/smart-whisper

Doesn't work in Electron.js's Node

Open
#51 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
TypeScript
Stars
77
Forks
10
PR merge metrics
No merged PRs in 30d

Description

Hi,

I'm trying to use this in Electron but it fails when transcribing with a vague error, I Googled it but didn't find anything
```
aheads_masks_init: dtw_n_top must be between 1 and 4 for this model.whisper_init_state: aheads_masks_init() failed for alignment heads masks
```

I have tried different models and toggling GPU option but no luck so far.

Full log:
```
whisper_init_from_file_with_params_no_state: loading model from '/Users/neo/.smart-whisper/models/ggml-large-v3-turbo-q8_0.bin'
whisper_init_with_params_no_state: use gpu = 0
whisper_init_with_params_no_state: flash attn = 0
whisper_init_with_params_no_state: gpu_device = 0
whisper_init_with_params_no_state: dtw = 16
whisper_model_load: loading model
whisper_model_load: n_vocab = 51866
whisper_model_load: n_audio_ctx = 1500
whisper_model_load: n_audio_state = 1280
whisper_model_load: n_audio_head = 20
whisper_model_load: n_audio_layer = 32
whisper_model_load: n_text_ctx = 448
whisper_model_load: n_text_state = 1280
whisper_model_load: n_text_head = 20
whisper_model_load: n_text_layer = 4
whisper_model_load: n_mels = 128
whisper_model_load: ftype = 7
whisper_model_load: qntvr = 2
whisper_model_load: type = 5 (large v3)
whisper_model_load: adding 1609 extra tokens
whisper_model_load: n_langs = 100
whisper_model_load: CPU total size = 873.55 MB
whisper_model_load: model size = 873.55 MB

whisper_print_timings: load time = 342.46 ms
whisper_print_timings: total time = 342.48 ms
whisper_init_state: kv self size = 31.46 MB
whisper_init_state: kv cross size = 31.46 MB
whisper_init_state: kv pad size = 7.86 MB
aheads_masks_init: dtw_n_top must be between 1 and 4 for this model.whisper_init_state: aheads_masks_init() failed for alignment heads masks
✨ Done in 10.68s.
```

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no source file, test, or entry point; start by reproducing transcription in Electron with the reported large-v3 model and reviewing the whisper initialization log. Done means transcription works in the Electron Node environment, or the supported model/configuration and failure are clearly documented.

Written by the indexing model from the issue text.

Assessment

Tech stack
electron, node.js, typescript
Domain
desktop
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.