digital-dream-labs / digital-dream-labs/vector-cloud
Propagation of WakeWordEnd and UserIntent for unmatched intents
- Dominant language
- Go
- Stars
- 36
- Forks
- 42
- PR merge metrics
- No merged PRs in 30d
Description
## Issue description
When a 'Hey Vector' user command phrase is not recognized or matched with existing intent, no event gets propagated throug the API at all, so all unrecognized events are dropped at the robot backend and clients do not even recognize that a robot command has been invoked, and ended ussuccessfully.
From the [current implementation](https://github.com/digital-dream-labs/vector-cloud/blob/main/internal/proto/external_interface/messages.pb.go#L4538-L4544), it seems that the logic of passing the 'unrecognized' intents further to the API has been started, but never finished.
## Suggested Resolution
- To finish this implementation and pass the transcription of the microphone audio, from the voice recognition service to the intent response, for both intent api methods
- WakeWordEnd - when the robot is not under behaviour control
- UserIntent - when the robot is under behaviour control
- With the actual voice recognition transcription available to api clients through this api endpoints, it would be possible to react to any phrase or keyword at a wish, and to process the whole parsing logic on the clients themselves, regardless of whether the phrase has been successully matched with a known backend intent or not (this will actually skyrocket the extension possibilites).
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.