RobotecAI / RobotecAI/rai

Integration & application of ROS4HRI

Open
#274 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement help wanted priority/minor ros
Dominant language
Python
Stars
589
Forks
76
Avg merge
1d 13h
Merged PRs (30d)
3

Description

Is your feature request related to a problem? Please describe.
While RAI has an optional voice interactivity package, there is no supporting tool yet to integrate human face & emotion detection, recognition, tracking, pose detection and so on. These are important elements of HRI.

Describe the solution you'd like
It would be best to integrate HRI capabilities in a modular way, respectful of diverse sensor, compute and platform setups. ROS4HRI standard and packages are a good fit to try out.

At first, an RFC for HRI should be proposed to gather community comments and feedback.

Describe alternatives you've considered
Integrating with a paid product, which is fine as an option, but not as a default since HRI is one of important aspects of embodied AI, and relying exclusively on a paid solution would limit accessibility of RAI.

Additional context
ROS4HRI github

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reviewing the ROS4HRI project linked in the issue and the existing voice interactivity package in RAI. Define an RFC for modular HRI integration that addresses face and emotion detection, recognition, tracking, and pose detection across diverse sensors, compute environments, and platforms. Done means the RFC is proposed for community comments and feedback.

Written by the indexing model from the issue text.

Assessment

Domain
robotics
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.