facebookresearch / facebookresearch/sam-3d-objects
Difficulty aligning Rotation when importing predicted GLB & Pose to Unity3D
- Dominant language
- Python
- Stars
- 7.4k
- Forks
- 878
- PR merge metrics
- No merged PRs in 30d
Description
Hi, thanks for the great work!
I am currently trying to import the predicted GLB files and their corresponding pose information (translation, rotation, scale) into Unity3D to perfectly simulate the spatial relationship between the objects and the camera.
**The Problem:** I am struggling to find the correct coordinate transformation for the Rotation.
**Translation**: I found that simply inverting the X-axis (Right-handed to Left-handed conversion: x_unity = -x_pred) makes the position perfectly correct relative to the camera.
**Rotation**: However, no matter what coordinate transformation I attempt for the rotation (Quaternion), the orientation of the object remains incorrect.
**What I have tried**:
Using the raw output directly.
Using the provided update_layout functions.
Any advice or snippets on mapping this rotation to Unity would be greatly appreciated.
Thanks!
Contributor guide
Assessment
This issue has not been assessed yet.