microsoft / microsoft/BotFramework-WebChat

Design: Microphone input indications

Open
#2,212 4 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

backlog feature-request needs-design-input
Dominant language
HTML
Stars
1.8k
Forks
1.6k
Avg merge
22h 58m
Merged PRs (30d)
2

Description

User story

Today, the end-user is not "crispy clear" on whether we are picking up their voice on the microphone.
States:

  • Dictate state (Started)
  • Idle
  • Starting
  • Stopping
  • (state between idle and starting) "Will start once synthesizing is complete" <-- this is not the final state name; any suggestions are welcome.

Alternatives

It is not trivial to customize the microphone button because:

  • Deep customization is required
  • Cognitive Services SDK does not fully support all events to build the UI
    • Developer will need to write their own package to listen to microphone

Other implementations

For example, Siri show a "bouncing sphere" to indicate when the user speak. And the bounce effect is based on microphone input, so the user is extremely clear that Siri is recording.

Potential implementation

Tomorrow, we could make the microphone record more prominent by following other apps.

In the future, we could add wake word capability. The end-user need a very clear indications that we are recording and analyzing their voice.

[Enhancement]

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

The issue names no files, tests, or entry points. Start by examining the microphone controls and speech-state handling, then clarify the proposed states and visual behavior; done would require an agreed design and implementation that clearly indicates recording, starting, stopping, idle, and deferred start.

Written by the indexing model from the issue text.

Assessment

Tech stack
html
Domain
audio-video-rtc, design, frontend
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.