agentscope-ai / agentscope-ai/agentscope

feat(realtime): add cascaded realtime model (asr-llm-tts)

オープン
#2,565 コメント 1 件 リアクション 0 件 担当者 0 名 GitHub で見る
主要言語
Python
スター
31.5k
フォーク
3.5k
平均マージ
1日 23時間
マージ済み PR(30日)
95

説明

**Background**
The current `RealtimeModel` relies on native speech-to-speech APIs, which have limited provider coverage and controllability. A cascaded pipeline (ASR → LLM → TTS) is a natural alternative — more flexible, provider-agnostic, and easier to debug.

The proposed approach is to implement a `CascadedRealtimeModel` that shares the same interface as the existing `RealtimeModel`, so that `RealtimeAgent` can switch between speech-to-speech and cascaded mode purely by swapping the `model` field. This design assumption needs to be validated against the current `RealtimeModel` interface before implementation.

> Depends on #2564 (ASR module abstraction) to be merged first.

**Changes**
- Implement `CascadedRealtimeModel` compatible with the existing `RealtimeModel` interface
- `RealtimeAgent` switches between speech-to-speech and cascaded mode via the `model` field only — no agent-level changes required
- Support streaming across all three stages to minimize end-to-end latency

コントリビューションガイド

コントリビューションガイドを開く

評価

この issue はまだ評価されていません。

新しい issue をメールで受け取る

初心者向けの GitHub issue を短くまとめたダイジェスト。