AOSSIE-Org / AOSSIE-Org/Resonate

iOS: Integrate JUCE DSP with Native Audio Capture and LiveKit Publishing

Aperta
#686 2 commenti 0 reazioni 1 assegnatario Rivendicata da @uju09 Vedi su GitHub
enhancement
Lingua principale
Dart
Stelle
344
Fork
350
Metriche di merge delle PR
Nessuna PR unita negli ultimi 30g

Descrizione

### 🚀 The feature

On iOS, replace LiveKit’s default microphone capture with a custom audio pipeline that:
• Captures microphone audio using AVAudioEngine
• Processes audio buffers using the shared JUCE DSP engine (via Objective-C++)
• Publishes processed audio buffers to LiveKit AudioTrack

The existing LiveKit transport layer remains unchanged.

### Motivation, pitch

To enable real-time, on-device voice processing on iOS, microphone audio must be captured natively and processed before being handed to LiveKit.

Using JUCE via Objective-C++ allows us to reuse the same DSP logic implemented for Android, ensuring consistent audio behavior across platforms. This approach maintains privacy, avoids server-side audio modification, and aligns with iOS real-time audio best practices.

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.