AOSSIE-Org / AOSSIE-Org/Resonate
iOS: Integrate JUCE DSP with Native Audio Capture and LiveKit Publishing
- Lenguaje dominante
- Dart
- Estrellas
- 344
- Forks
- 350
- Métricas de merge de PR
- Sin PR fusionados en 30 d
Descripción
### 🚀 The feature
On iOS, replace LiveKit’s default microphone capture with a custom audio pipeline that:
• Captures microphone audio using AVAudioEngine
• Processes audio buffers using the shared JUCE DSP engine (via Objective-C++)
• Publishes processed audio buffers to LiveKit AudioTrack
The existing LiveKit transport layer remains unchanged.
### Motivation, pitch
To enable real-time, on-device voice processing on iOS, microphone audio must be captured natively and processed before being handed to LiveKit.
Using JUCE via Objective-C++ allows us to reuse the same DSP logic implemented for Android, ensuring consistent audio behavior across platforms. This approach maintains privacy, avoids server-side audio modification, and aligns with iOS real-time audio best practices.
Guía de contribución
Evaluación
Este issue todavía no se ha evaluado.