AOSSIE-Org / AOSSIE-Org/Resonate

iOS: Integrate JUCE DSP with Native Audio Capture and LiveKit Publishing

Ouverte
#686 2 commentaires 0 réactions 1 personne assignée Réclamée par @uju09 Voir sur GitHub
enhancement
Langage dominant
Dart
Étoiles
344
Forks
350
Métriques de merge des PR
Aucune PR mergée en 30 j

Description

### 🚀 The feature

On iOS, replace LiveKit’s default microphone capture with a custom audio pipeline that:
• Captures microphone audio using AVAudioEngine
• Processes audio buffers using the shared JUCE DSP engine (via Objective-C++)
• Publishes processed audio buffers to LiveKit AudioTrack

The existing LiveKit transport layer remains unchanged.

### Motivation, pitch

To enable real-time, on-device voice processing on iOS, microphone audio must be captured natively and processed before being handed to LiveKit.

Using JUCE via Objective-C++ allows us to reuse the same DSP logic implemented for Android, ensuring consistent audio behavior across platforms. This approach maintains privacy, avoids server-side audio modification, and aligns with iOS real-time audio best practices.

Guide de contribution

Ouvrir le guide de contribution

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.