google-deepmind / google-deepmind/open_x_embodiment

Inconsistent model output across training datasets

Open
#7 1 comment 3 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
2k
Forks
127
PR merge metrics
No merged PRs in 30d

Description

For the bridge dataset, the model output is explicitly de-normalized before being compared with the ground truth in the inference notebook.

For other datasets, e.g. Viola, and Berkley cable routing, the raw model predictions match quite well with the ground truth. Does this mean the ground truth actions in these datasets are normalized?

How one should denormalize to interpret the model output e.g. for Franka

It would be helpful to know how datasets are normalized (at least the 9 datasets RT1-X is trained on) and if this is consistent across 9 datasets.

Thanks!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.