NVIDIA / NVIDIA/cosmos-framework

Request for an Example of the 57D Egocentric Motion Input

Open
#31 9 comments 1 reaction 1 assignee View on GitHub

@qianlim is already working on this.

Since Jun 13, 2026.

Dominant language
Python
Stars
535
Forks
148
Avg merge
13h 37m
Merged PRs (30d)
35

Description

Hi, thank you for releasing this great project!

I am currently trying to use the Egocentric Motion input, but I am a bit confused about the format of the 57D action representation.

Could you please provide a simple example of the Egocentric Motion input (e.g., a sequence of 57D actions) or explain how each dimension is defined?

In particular, I would like to understand:

What coordinate system is used (camera coordinate, world coordinate, or another convention)?
What is the scale/unit of the translation values (meters, centimeters, normalized values, etc.)?
Are the rotation values represented as Euler angles, axis-angle, quaternions, or another format?
Is any normalization applied to the 57D action before feeding it into the model?

Having a concrete example or a description of the preprocessing would be extremely helpful for reproducing the results.

Thank you very much for your help!

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.