isl-org / isl-org/Open3D

Accessing specific vertices programatically using their 2d coordinates in some specific camera view?

Open
#3,687 1 comment 0 reactions 0 assignees View on GitHub
viewcontrol visualization
Dominant language
C++
Stars
14k
Forks
2.6k
Avg merge
5d 18h
Merged PRs (30d)
6

Description

**Is your feature request related to a problem? Please describe.**
While I am able to view my mesh from a given camera view, I'm not sure how I can access vertices by their location in the 2D image?
My motivation for accessing vertices from the cameras view is to be able to modify them, e.g., paint all the points that are projected to the bottom-half of the 2d image (as rendered by the visualizer).

**Describe the solution you'd like**
It'd be great if an api would be exposed, that allows accessing point clouds / vertices via the visualizer (like VisualizerWithEditing, but non-interactively).

**An alternative I considered:**
1. deduce the xyz coordinates of points obtained from a depth image (capture_depth_float_buffer())
2. transform these into world coordinates by using the camera extrinsics
3. then identify the vertices in the mesh by searching at the obtained set of coordinates.

But I imagine there must be a more direct and efficient way to do that..

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.