intel / intel/ros2_openvino_toolkit

New model support for Speech Recognition

Open
#285 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C++
Stars
187
Forks
89
PR merge metrics
No merged PRs in 30d

Description

Adds support for Speech Recognition network. Here are some model from open model zoo. You can pick anyone from those model or any other pose estimation model you are prefer
[mozilla-deepspeech-0.6.1](https://github.com/openvinotoolkit/open_model_zoo/tree/master/models/public/mozilla-deepspeech-0.6.1)
[quartznet-15x5-en](https://github.com/openvinotoolkit/open_model_zoo/tree/master/models/public/quartznet-15x5-en)
[wav2vec2-base](https://github.com/openvinotoolkit/open_model_zoo/tree/master/models/public/wav2vec2-base)

The potential work should be:

- Add new sub-class as child of [base input](https://github.com/intel/ros2_openvino_toolkit/blob/master/openvino_wrapper_lib/include/openvino_wrapper_lib/inputs/base_input.hpp) to parse the new input type for speech.
- Add new sub-class as child of [base Inference] (https://github.com/intel/ros2_openvino_toolkit/blob/master/openvino_wrapper_lib/include/openvino_wrapper_lib/inferences/base_inference.hpp) for Speech Recognition inference
- Add new sub-class as child of [base model](https://github.com/intel/ros2_openvino_toolkit/blob/master/openvino_wrapper_lib/include/openvino_wrapper_lib/models/base_model.hpp) for Speech Recognition model parsing.
- Add new sub-class as child of [base output](https://github.com/intel/ros2_openvino_toolkit/blob/master/openvino_wrapper_lib/include/openvino_wrapper_lib/outputs/base_output.hpp) to show the speech recognition results.
- [Optional] Create new ROS2 message type and update ros_topic_output and rviz_output

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.