bugbakery / bugbakery/transcribee
Pauses and spaces in `Atom`s
- Dominant language
- TypeScript
- Stars
- 515
- Forks
- 39
- Avg merge
- 19h 36m
- Merged PRs (30d)
- 15
Description
Currently we generated `Atom`s for approximately every whisper token. These tokens notably include spaces that separate words.
Alignment is performed on the basis of these `Atom`s and the timing stored to the `Atom` is the timing including theses spaces.
For spaces inside a whole sentence this is not really significant, but for audio files that include long pauses between multiple sentences (like music) or have a long pause at the start of the file, the timing will usually include this long pause with the first `Atom` following this pause.
This means when the user clicks on the `Atom` to start playback from this point, the user will have to listen to this long pause before the interesting part with speech starts.
Do we think this is acceptable?
I think timings specified for a `Atom` should always include all "characters" in the `Atom`s text. So if a leading space is included in this `Atom`, the pause for that space should also be included in the timing.
So if we think the user having to wait for a long pause to be over is not acceptable the only way forward is splitting spaces and punctuation into separate `Atom`s.
Contributor guide
Assessment
This issue has not been assessed yet.