NVIDIA / NVIDIA/IsaacTeleop

How to use device plugin in robot teleop

Open
#740 0 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Python
Stars
385
Forks
88
Avg merge
3d 23h
Merged PRs (30d)
82

Description

The basic plugin test like foot_pedal_locomotion_example.py uses TeleopSession and retargeter pipeline to get inputs from the plugin. However the robot teleop example from IsaacLab, i.e., teleop_se3_agent.py, uses isaaclab.envs and teleopinterface.

I need to use inputs from a controller plugin in the robot teleop example - teleop_se3_agent.py.
What is the recommended way to do it?

Any example code, best practices, or guidance on how to properly combine the TeleopSession pipeline with Isaac Lab’s teleop environment would be greatly appreciated.

Thanks!

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Compare foot_pedal_locomotion_example.py, which uses TeleopSession and the retargeter pipeline, with IsaacLab's teleop_se3_agent.py, which uses isaaclab.envs and teleopinterface. Trace how each obtains controller inputs and determine the recommended integration boundary; done should include documented guidance or an example showing the two pipelines working together.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
robotics
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.