microsoft / microsoft/BotFramework-WebChat

Design: Switching input mode

Open
#2,211 13 comments 5 reactions 2 assignees View on GitHub

Nobody has claimed this yet.

feature-request needs-design-input
Dominant language
HTML
Stars
1.8k
Forks
1.6k
Avg merge
22h 58m
Merged PRs (30d)
2

Description

User story

Today, we mix typing and speech into the send box.

The end-user is not very indicative on whether the microphone is recording or not, especially without a waveform animation.

Please look at #1839 when working on this.

Alternatives

Today, we mix the input via keyboard and speech into a single input box.

Other implementations

Send box in Cortana and Siri can be either for keyboard or speech, but not hybrid.

Potential implementation

Tomorrow, we could use the microphone button to switch between 2+ types of input. And the end-user should has a very clear indication on what type of inputs they are using.

image

What this will fix?

  • Synthesize all bot responses
    • Ability to synthesize all bot responses are very popular asks
  • Synthesize proactive messages
    • When the user switch to speech mode, we can prime Web Audio API thru user gesture. This will enable synthesizing all proactive messages (#2474)
  • Synthesize bot responses on file uploads
    • We also need to cater about file upload. If the user is in microphone input mode, they should still be able to upload files (e.g. mobile scenario). And the bot responses will be synthesized (#2474).
  • #2568

[Enhancement]

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.