AOSSIE-Org / AOSSIE-Org/Resonate

Android: Integrate JUCE DSP with Native Audio Capture and LiveKit Publishing

Offen
#685 1 Kommentar 0 Reaktionen 1 zugewiesene Person Beansprucht von @uju09 Auf GitHub ansehen
enhancement
Vorherrschende Sprache
Dart
Sterne
344
Forks
350
PR-Merge-Kennzahlen
Keine gemergten PRs in 30 T.

Beschreibung

### 🚀 The feature

On Android, replace LiveKit’s default microphone input with a custom audio pipeline that:
• Captures microphone audio using native APIs (AudioRecord / Oboe)
• Processes audio buffers using the shared JUCE DSP engine
• Publishes DSP-processed audio to LiveKit as the audio track

LiveKit’s transport, encoding, and room logic remain unchanged.

### Motivation, pitch

Android currently publishes raw microphone audio directly to LiveKit. To support client-side voice processing, we need to intercept audio before publishing.

Implementing this natively ensures low latency and real-time safety, while JUCE guarantees consistent DSP behaviour across platforms. This change is limited in scope to input replacement and does not modify LiveKit internals or server-side behaviour.

Beitragsleitfaden

Beitragsleitfaden öffnen

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.