facebookresearch / facebookresearch/sam-3d-objects

Difficulty aligning Rotation when importing predicted GLB & Pose to Unity3D

Open
#91 6 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
7.4k
Forks
878
PR merge metrics
No merged PRs in 30d

Description

Hi, thanks for the great work!

I am currently trying to import the predicted GLB files and their corresponding pose information (translation, rotation, scale) into Unity3D to perfectly simulate the spatial relationship between the objects and the camera.

**The Problem:** I am struggling to find the correct coordinate transformation for the Rotation.

**Translation**: I found that simply inverting the X-axis (Right-handed to Left-handed conversion: x_unity = -x_pred) makes the position perfectly correct relative to the camera.

**Rotation**: However, no matter what coordinate transformation I attempt for the rotation (Quaternion), the orientation of the object remains incorrect.

**What I have tried**:

Using the raw output directly.

Using the provided update_layout functions.

Any advice or snippets on mapping this rotation to Unity would be greatly appreciated.

Thanks!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.