microsoft / microsoft/CopilotStudioSamples

Copilot Studio agent integrated with Azure Voice Live API (real-time voice)

Open
#438 0 comments 3 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
TypeScript
Stars
797
Forks
491
PR merge metrics
No merged PRs in 30d

Description

Is your feature request related to a problem? Please describe.
There is currently no end-to-end sample in this repo that demonstrates how to run a Copilot Studio agent with real-time voice using the Azure Voice Live API.
For makers/devs it’s hard to get started because the required wiring (streaming audio, turn-taking, barge-in, auth, configuration, and deployment) is not obvious without a reference implementation.

Describe the solution you'd like
Please add a working sample/template that shows a Copilot Studio agent running with Azure Voice Live API, including:

  • A minimal web client (browser microphone) for real-time conversation (push-to-talk or open-mic).
  • A lightweight backend (Azure Functions / Node / .NET) that connects to Azure Voice Live API for low-latency audio streaming and forwards text/turns to the Copilot Studio agent.
  • Clear setup steps + required environment variables (keys, endpoints, region, agent/channel configuration).
  • Support for:
    • streaming input (mic) + streaming output (TTS)
    • barge-in (interrupting TTS when user starts speaking)
    • basic turn-taking and session lifecycle (start/stop)
    • logging/troubleshooting guidance (common errors and how to debug)
  • Optional but very helpful:
    • IaC (Bicep/Terraform) to deploy required Azure resources
    • a simple architecture diagram and sequence diagram

Describe alternatives you've considered

  • Using Speech SDK samples or custom integrations, but they don’t provide a Copilot Studio-specific, copy/paste starter template in this repo.
  • Using non-real-time voice approaches (record-then-send) which increases latency and reduces user experience.

Additional context
Use cases:

  • Voice-enabled Copilot Studio agent in a web app (no phone/PSTN required).
  • A reference implementation would help teams standardize on a supported pattern for real-time voice (auth, session management, and reliable streaming).

If needed, I can help test the sample on a real tenant and provide feedback/PRs for documentation.

Contributor guide

No contributing guide indexed for this repository

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No repository files or tests are identified. Start by reviewing the requested minimal web client and lightweight backend scope, including authentication, streaming, turn-taking, barge-in, and session lifecycle. Done means a working Copilot Studio and Azure Voice Live API sample with setup, environment variables, troubleshooting guidance, and any included deployment or diagram artifacts.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, typescript
Domain
ai, audio-video-rtc, backend, cloud, frontend
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.