dimensionalOS / dimensionalOS/dimos

Add voice input (speech-to-text) to HumanCLI for Go2

Open
#1,272 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

agents
Dominant language
Python
Stars
4.5k
Forks
808
Avg merge
3d 5h
Merged PRs (30d)
233

Description

Issue

Add voice input capability to HumanCLI so users can speak commands instead of typing them. Validate that it works on the Unitree Go2 platform.

Requirements

  • Implement speech-to-text using Python audio libraries (e.g., pyaudio, speech_recognition, or similar)
  • Add directly to HumanCLI module (dimos/agents/cli/human.py)
  • Support microphone input on Go2
  • Handle audio device selection/configuration
  • Test on actual Go2 hardware

Implementation Considerations

  • Use lightweight STT that runs on-device or can call external API
  • Handle noise/background audio on robot
  • Provide fallback to typed input if voice fails
  • Toggle for enabling/disabling voice input

Acceptance Criteria

  • Voice input works on Go2
  • User can speak commands to the agent
  • Transcription is accurate enough for navigation/control commands
  • Graceful fallback to text input if voice unavailable

Related

  • Pair with: #1273 (Voice output TTS)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start in dimos/agents/cli/human.py and review the HumanCLI input flow before choosing the Python audio or speech-to-text approach. Validate microphone selection, voice-to-text commands, typed fallback, and the enable/disable toggle on actual Unitree Go2 hardware; completion requires the listed voice-input acceptance criteria to work there.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
cli, embedded-iot
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
28/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.