dimensionalOS / dimensionalOS/dimos
Add Doom Control to drive robot
@christiefhyang is already working on this.
Since Mar 3, 2026.
- Dominant language
- Python
- Stars
- 4.5k
- Forks
- 808
- Avg merge
- 3d 5h
- Merged PRs (30d)
- 233
Description
-
Quest-Side Application
Use Unity / Unreal / or native OpenXR to build a Quest app.
Obtain pose, button, joystick, and other input data from the headset and controllers.
Package these inputs into simple “control commands” (e.g., target velocity / relative pose / high-level instructions). -
Network Protocol
Send the data from the Quest device to the PC via WebSocket / UDP / gRPC, etc.
On the PC / DimOS side, implement a small module to receive these messages. -
“Quest Teleop” Module on the DimOS Side
Convert the received Quest control messages into:
• Twist → /cmd_vel (velocity), or
• PoseStamped → /goal_pose (pose),
Fully reuse the control interface I have already implemented under #1159. -
Integration Testing and Simulation Validation
First connect the Quest control to a MuJoCo simulation to verify input/output consistency.
After validation in simulation, connect to the real robot.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.