facebookresearch / facebookresearch/sam-3d-objects

The rotation transformation of the generated model may not be consistent with what is shown in the demo

Open
#132 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
7.4k
Forks
878
PR merge metrics
No merged PRs in 30d

Description

This ai model is astonishing. In the field of monocular image generation, I think it's invincible. However, when I tried to apply it quickly, I found that no matter how I used it, it was incorrect. To verify it quickly, I didn't deploy it locally. Instead, I directly uploaded the image generation model on your official website, downloaded the glb to my local device, and loaded it with three. The quaternions, positions and scaling of this model were returned from your interface. Scaling and such are all normal, except for rotation.
In terms of explanation, this quaternion represents the posture of "model local coordinates → camera coordinates". However, when I turned it according to the camera coordinate system of p3d, I found that no matter how I turned it, it was incorrect. The coordinate system of three is a right-handed coordinate system.
So, could you tell me what coordinate system the quaternion of the returned information is in?
Image

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.