bugbakery / bugbakery/transcribee

Pauses and spaces in `Atom`s

Open
#23 0 comments 0 reactions 0 assignees View on GitHub
discuss
Dominant language
TypeScript
Stars
515
Forks
39
Avg merge
19h 36m
Merged PRs (30d)
15

Description

Currently we generated `Atom`s for approximately every whisper token. These tokens notably include spaces that separate words.

Alignment is performed on the basis of these `Atom`s and the timing stored to the `Atom` is the timing including theses spaces.
For spaces inside a whole sentence this is not really significant, but for audio files that include long pauses between multiple sentences (like music) or have a long pause at the start of the file, the timing will usually include this long pause with the first `Atom` following this pause.

This means when the user clicks on the `Atom` to start playback from this point, the user will have to listen to this long pause before the interesting part with speech starts.

Do we think this is acceptable?

I think timings specified for a `Atom` should always include all "characters" in the `Atom`s text. So if a leading space is included in this `Atom`, the pause for that space should also be included in the timing.
So if we think the user having to wait for a long pause to be over is not acceptable the only way forward is splitting spaces and punctuation into separate `Atom`s.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.