facebookresearch / facebookresearch/sam-3d-objects

Controlling output mesh scale for scene integration

Open
#121 0 comments 2 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
7.4k
Forks
878
PR merge metrics
No merged PRs in 30d

Description

Thank you for sharing this excellent project.

I am currently attempting to use the mesh generated by SAM3D as an initialization for another scene. However, I noticed that the mesh generated using the provided demo code is significantly larger than the scale of the target scene I am applying it to.

My Questions I would like to clarify the recommended workflow for handling scale mismatches:

1. Direct Scale Input: Does SAM3D currently support a feature where I can provide a specific target scale as an input to generate the 3D object directly at that size?

2. Manual Alignment: Or, is it expected that I implement a manual alignment algorithm (e.g., Procrustes alignment) to match the pose/scale of the SAM3D output (camera & mesh) to my target scene?

3. Parameter Adjustment: Alternatively, is there a specific parameter in the output (e.g., within the transformation dictionary) that I should be using to rescale the mesh to the correct metric size?

Any guidance on how to properly align the output scale would be greatly appreciated.

Thank you!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.