isl-org / isl-org/Open3D

read_point_cloud tensor API crashes with large Point Clouds (Segmentation Fault)

Open
#7,402 4 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
C++
Stars
14k
Forks
2.6k
Avg merge
5d 18h
Merged PRs (30d)
6

Description

### Checklist

- [x] I have searched for [similar issues](https://github.com/isl-org/Open3D/issues).
- [x] For Python issues, I have tested with the [latest development wheel](https://www.open3d.org/docs/latest/getting_started.html#development-version-pip).
- [x] I have checked the [release documentation](https://www.open3d.org/docs/release/) and the [latest documentation](https://www.open3d.org/docs/latest/) (for `main` branch).

### Describe the issue

Hi, I looked for a similar issue but could not find it directly. When reading a large .pcd point cloud (~1.2B points) with xyz and a custom field "labels", the process crashes with a "Segmentation fault" messsage. The same works for smaller .pcd files, however, and the old API can even open larger .pcd files (not with custom fields though).

Here is the header of the file I tried to open:
```
VERSION 0.7
FIELDS x y z labels
SIZE 4 4 4 4
TYPE F F F U
COUNT 1 1 1 1
WIDTH 1201172100
HEIGHT 1
VIEWPOINT 0.0 0.0 0.0 1.0 0.0 0.0 0.0
POINTS 1201172100
DATA binary
```
I know I have enough RAM for this (600+ GB), and the whole .pcd filesize is 18GB. I was able to successfully open it with pypcd4, however, it needs a copy to bring it to numpy and then transfer into the Open3D Tensor API.

I saw many similar problems in issues so I do not hope for a fast fix but just letting you know if anyone encounters the same

### Steps to reproduce the bug

```python
tensor_pcd = o3d.t.io.read_point_cloud(path)
```

### Error message

Segmentation fault

### Expected behavior

_No response_

### Open3D, Python and System information

```markdown
- Operating system: Debian GNU/Linux 12 (bookworm)
- Python version: Python 3.11.14
- Open3D version: 0.19.0
- System architecture: x86
- Is this a remote workstation?: yes
- How did you install Open3D?: pip
```

### Additional information

_No response_

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.