microsoft / microsoft/CopilotStudioSamples
Copilot Studio agent integrated with Azure Voice Live API (real-time voice)
Nobody has claimed this yet.
- Dominant language
- TypeScript
- Stars
- 797
- Forks
- 491
- PR merge metrics
- No merged PRs in 30d
Description
Is your feature request related to a problem? Please describe.
There is currently no end-to-end sample in this repo that demonstrates how to run a Copilot Studio agent with real-time voice using the Azure Voice Live API.
For makers/devs it’s hard to get started because the required wiring (streaming audio, turn-taking, barge-in, auth, configuration, and deployment) is not obvious without a reference implementation.
Describe the solution you'd like
Please add a working sample/template that shows a Copilot Studio agent running with Azure Voice Live API, including:
- A minimal web client (browser microphone) for real-time conversation (push-to-talk or open-mic).
- A lightweight backend (Azure Functions / Node / .NET) that connects to Azure Voice Live API for low-latency audio streaming and forwards text/turns to the Copilot Studio agent.
- Clear setup steps + required environment variables (keys, endpoints, region, agent/channel configuration).
- Support for:
- streaming input (mic) + streaming output (TTS)
- barge-in (interrupting TTS when user starts speaking)
- basic turn-taking and session lifecycle (start/stop)
- logging/troubleshooting guidance (common errors and how to debug)
- Optional but very helpful:
- IaC (Bicep/Terraform) to deploy required Azure resources
- a simple architecture diagram and sequence diagram
Describe alternatives you've considered
- Using Speech SDK samples or custom integrations, but they don’t provide a Copilot Studio-specific, copy/paste starter template in this repo.
- Using non-real-time voice approaches (record-then-send) which increases latency and reduces user experience.
Additional context
Use cases:
- Voice-enabled Copilot Studio agent in a web app (no phone/PSTN required).
- A reference implementation would help teams standardize on a supported pattern for real-time voice (auth, session management, and reliable streaming).
If needed, I can help test the sample on a real tenant and provide feedback/PRs for documentation.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
No repository files or tests are identified. Start by reviewing the requested minimal web client and lightweight backend scope, including authentication, streaming, turn-taking, barge-in, and session lifecycle. Done means a working Copilot Studio and Azure Voice Live API sample with setup, environment variables, troubleshooting guidance, and any included deployment or diagram artifacts.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- azure, typescript
- Domain
- ai, audio-video-rtc, backend, cloud, frontend
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 25/100