ByteDance-Seed / ByteDance-Seed/Depth-Anything-3

How to align exported Gaussian parameters with the point cloud from GLB export?

Open
#212 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
6.3k
Forks
702
PR merge metrics
No merged PRs in 30d

Description

Thank you for the amazing work! I am trying to render the scene from a Bird's Eye View (BEV). However, I noticed that the exported 3D Gaussian (GS) parameters and the Point Cloud (PLY) used in the GLB export are not in the same coordinate system. When I use the same BEV camera to render both the GS and the GLB point cloud, the results are significantly different in terms of position and orientation. It seems that the point cloud in the GLB has been aligned to the input world space, while the GS parameters remain in the model's internal normalized space.

My Question:
What is the standard procedure to transform the GS parameters (means, rotations, and scales) to the same world coordinate system as the GLB point cloud? Could you please provide the Sim3 transformation logic (Rotation, Translation, and Scale) required to perform this alignment?

Best regards,

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by tracing how the GLB point cloud and the exported Gaussian parameters are produced, focusing on the export paths mentioned in the issue. Compare their coordinate spaces, including means, rotations, and scales, and identify the Sim3 rotation, translation, and scale needed for alignment. Done means documenting a reproducible transformation procedure that makes both outputs agree under the same BEV camera.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
computer-graphics, computer-vision
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.