microsoft / microsoft/BotFramework-WebChat

Continuous Speech Recognition with Interrupt/Barge-In Support

Open
#5,589 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Bot Services customer-reported question
Dominant language
HTML
Stars
1.8k
Forks
1.6k
Avg merge
22h 58m
Merged PRs (30d)
2

Description

I have a question

Hi,

I’m working on integrating continuous speech recognition in my web application using Azure Cognitive Services / Bot Framework Web Chat. My goal is to allow the user to speak continuously while the bot is responding with text-to-speech, and ideally, the user should be able to interrupt the bot’s speech by speaking (barge-in).

Here’s what I have so far:

Speech-to-text works on mic click.

Text-to-speech is functional.

Currently, when the bot is speaking, the mic is disabled, and the user cannot interrupt.

I want to achieve a flow like:

User clicks the mic → starts speaking → speech-to-text captures input.

Bot responds with text-to-speech.

User should be able to start speaking at any time, even if the bot is talking, and have the bot stop its speech and process the user input.

Questions:

How can I implement continuous speech recognition while the bot is speaking?

Is there a way to configure automatic barge-in in Bot Framework Web Chat with Azure Cognitive Services?

Can the mic and speaker be active simultaneously in the browser for this use case?

Any sample implementation or guidance would be greatly appreciated.

Thanks!

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue mentions Azure Cognitive Services and Bot Framework Web Chat but identifies no repository file, test, or entry point. Before implementation, clarify the supported browser behavior, Web Chat scope, and acceptance criteria for simultaneous recognition and speech interruption.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure
Domain
audio-video-rtc, frontend
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.