aws-samples / aws-samples/amazon-sumerian-hosts
Glitchy audio after 5 to 10 minutes
- Dominant language
- JavaScript
- Stars
- 210
- Forks
- 83
- PR merge metrics
- No merged PRs in 30d
Description
I have noticed in my scene that after about 5 to 10 minutes of generating audio, the audio gets "glitchy". In other words, after having my Sumerian Host characters (3 of them) talk for about 5 to 10 minutes straight, the audio starts to develop really bad ticks and pops in it, to the point it is unlistenable (think of a really old, scratchy vinyl record being played).. This usually ends up being an audio buffer handling problem somewhere. It happens every time and the symptoms are always the same. A few minutes of perfect audio, then a single tick or a pop here or there, and then once the ticks and pops start happening, it exponentially increases rapidly to the unlistenable stage to where it happens with every audio buffer being played.
I know this might be a Chrome thing, but just in case, is there a way to "patch" into the audio generation code of the Sumerian host library and play the audio with something else, in my case Howler.js, while maintaining the lip sync between the audio and the character/host animation?
Contributor guide
Research direction
Reproduce the issue by having three Sumerian Host characters generate audio continuously for 5–10 minutes in Chrome, then inspect the Sumerian Hosts audio generation and playback path. Determine what causes the accumulating ticks and pops, and verify that any fix preserves lip synchronization; the issue names no source file or test.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- javascript
- Domain
- audio-video-rtc
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100