AOSSIE-Org / AOSSIE-Org/Resonate

Android: Integrate JUCE DSP with Native Audio Capture and LiveKit Publishing

Open
#685 1 comment 0 reactions 1 assignee Claimed by @uju09 View on GitHub
enhancement
Dominant language
Dart
Stars
344
Forks
350
PR merge metrics
No merged PRs in 30d

Description

### 🚀 The feature

On Android, replace LiveKit’s default microphone input with a custom audio pipeline that:
• Captures microphone audio using native APIs (AudioRecord / Oboe)
• Processes audio buffers using the shared JUCE DSP engine
• Publishes DSP-processed audio to LiveKit as the audio track

LiveKit’s transport, encoding, and room logic remain unchanged.

### Motivation, pitch

Android currently publishes raw microphone audio directly to LiveKit. To support client-side voice processing, we need to intercept audio before publishing.

Implementing this natively ensures low latency and real-time safety, while JUCE guarantees consistent DSP behaviour across platforms. This change is limited in scope to input replacement and does not modify LiveKit internals or server-side behaviour.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.