google-deepmind / google-deepmind/open_x_embodiment

How to construct an RLDS dataset?

Open
#98 0 comments 2 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
2k
Forks
127
PR merge metrics
No merged PRs in 30d

Description

I want to fine-tune the Octo model, but I don't know how to construct my own RLDS dataset. I have already built a reinforcement learning environment using **dm_env**, performed simulation with **Isaac Gym,** and generated an RLDS dataset using **envlogger**.
```
for i in range(FLAGS.num_episodes):
timestep = env.reset()
while True:
# TODO: HOW TO GENERATE ACTION
action = np.random.uniform(-3, 3, size=(9,)).astype(np.float32)
timestep = env.step(action)
iimt_gym_env.render()
iimt_gym_env.close()
```
However, for the **action** part, how should I control the robotic arm to generate grasping motion trajectories? Should it be learned through a reward function, controlled via a keyboard or gamepad, or through motion capture? I'm quite confused about this. Could someone tell me the general solution?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.