digital-dream-labs / digital-dream-labs/vector-cloud

Propagation of WakeWordEnd and UserIntent for unmatched intents

Open
#4 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Go
Stars
36
Forks
42
PR merge metrics
No merged PRs in 30d

Description

## Issue description
When a 'Hey Vector' user command phrase is not recognized or matched with existing intent, no event gets propagated throug the API at all, so all unrecognized events are dropped at the robot backend and clients do not even recognize that a robot command has been invoked, and ended ussuccessfully.

From the [current implementation](https://github.com/digital-dream-labs/vector-cloud/blob/main/internal/proto/external_interface/messages.pb.go#L4538-L4544), it seems that the logic of passing the 'unrecognized' intents further to the API has been started, but never finished.

## Suggested Resolution
- To finish this implementation and pass the transcription of the microphone audio, from the voice recognition service to the intent response, for both intent api methods
- WakeWordEnd - when the robot is not under behaviour control
- UserIntent - when the robot is under behaviour control

- With the actual voice recognition transcription available to api clients through this api endpoints, it would be possible to react to any phrase or keyword at a wish, and to process the whole parsing logic on the clients themselves, regardless of whether the phrase has been successully matched with a known backend intent or not (this will actually skyrocket the extension possibilites).

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.