classtranscribe / classtranscribe/FrontEnd

Captioning mismatch when videos have no dialogue

Open
#260 5 comments 0 reactions 0 assignees View on GitHub
Dominant language
JavaScript
Stars
24
Forks
29
PR merge metrics
No merged PRs in 30d

Description

What happens is when the video has a long silent period (like an intro) the captions start playing but the actual dialogue starts later. For about ~30-40s the captions are correct and ahead but at some point it does correct itself. For example in STAT 420 lecture `uuid=5cf8d03c-88bb-4e32-95fb-075c90265bf4` where the speaking starts at around 8 seconds but the captions start playing earlier.

![image](https://user-images.githubusercontent.com/7780198/99257724-18aa4600-27dd-11eb-804c-a1027081a041.png)

I think I've also seen it in the middle of videos where there is a silence and the rest of the captioning gets an offset from then on as well.

---

I'm not sure if this has been brought up before, but I on quick glance of the issues on `FrontEnd` and `WebAPI` I couldn't find an issue related to this. I've reported to professors I've had issues with synchronization but I'm not sure where that ended up. I've noticed this in several courses over the year (CS 241, 357, 418, STAT 420) and was one of the main reasons I didn't use classtranscribe for the longest time.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the mismatch with the STAT 420 video UUID 5cf8d03c-88bb-4e32-95fb-075c90265bf4, especially the silent period before speech begins. Trace how the FrontEnd starts and maintains caption playback during silence, then compare behavior across the reported courses. Done means captions remain synchronized through initial and mid-video silent periods.

Written by the indexing model from the issue text.

Assessment

Tech stack
javascript, react, redux
Domain
audio-video-rtc, frontend
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.