microsoft / microsoft/BotFramework-WebChat
Continuous Speech Recognition with Interrupt/Barge-In Support
Nobody has claimed this yet.
- Dominant language
- HTML
- Stars
- 1.8k
- Forks
- 1.6k
- Avg merge
- 22h 58m
- Merged PRs (30d)
- 2
Description
I have a question
Hi,
I’m working on integrating continuous speech recognition in my web application using Azure Cognitive Services / Bot Framework Web Chat. My goal is to allow the user to speak continuously while the bot is responding with text-to-speech, and ideally, the user should be able to interrupt the bot’s speech by speaking (barge-in).
Here’s what I have so far:
Speech-to-text works on mic click.
Text-to-speech is functional.
Currently, when the bot is speaking, the mic is disabled, and the user cannot interrupt.
I want to achieve a flow like:
User clicks the mic → starts speaking → speech-to-text captures input.
Bot responds with text-to-speech.
User should be able to start speaking at any time, even if the bot is talking, and have the bot stop its speech and process the user input.
Questions:
How can I implement continuous speech recognition while the bot is speaking?
Is there a way to configure automatic barge-in in Bot Framework Web Chat with Azure Cognitive Services?
Can the mic and speaker be active simultaneously in the browser for this use case?
Any sample implementation or guidance would be greatly appreciated.
Thanks!
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue mentions Azure Cognitive Services and Bot Framework Web Chat but identifies no repository file, test, or entry point. Before implementation, clarify the supported browser behavior, Web Chat scope, and acceptance criteria for simultaneous recognition and speech interruption.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- azure
- Domain
- audio-video-rtc, frontend
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100