Segfault when integrating few depth images with new reconstruction system

### Checklist

- [X] I have searched for [similar issues](https://github.com/isl-org/Open3D/issues).
- [X] For Python issues, I have tested with the [latest development wheel](http://www.open3d.org/docs/latest/getting_started.html#development-version-pip).
- [X] I have checked the [release documentation](http://www.open3d.org/docs/release/) and the [latest documentation](http://www.open3d.org/docs/latest/) (for `master` branch).

### Describe the issue

I am running the depth image integration example with the new reconstruction system. I am running the script in

`Open3D/examples/python/t_reconstruction_system/integrate.py`

with the default configuration, and it works when integrating the 3000 depth images, but if I change the script to only integrate two frames, it segfaults.

### Steps to reproduce the bug

```python
cd examples/python/t_reconstruction_system

apply the following patch

diff --git a/examples/python/t_reconstruction_system/integrate.py b/examples/python/t_reconstruction_system/integrate.py
index a8b02f3ff..b3b5d19ab 100644
--- a/examples/python/t_reconstruction_system/integrate.py
+++ b/examples/python/t_reconstruction_system/integrate.py
@@ -74,7 +74,7 @@ def integrate(depth_file_names, color_file_names, depth_intrinsic,
device=device)

start = time.time()
- for i in range(n_files):
+ for i in range(n_files)[:2]:
print('Integrating frame {}/{}'.format(i, n_files))

depth = o3d.t.io.read_image(depth_file_names[i]).to(device)

then run examples/python/t_reconstruction_system/integrate.py
```

### Error message

Config file was not provided, falling back to default dataset.
Loaded data from /home/me/open3d_data/extract/LoungeRGBDImages
Voxel block grid npz file vbg.npz not found, trying to integrate...
Integrating frame 0/3000
Integrating frame 1/3000
Finished integrating 3000 frames in 0.008063554763793945 seconds
Saving to vbg.npz...
Saving finished
Aborted (core dumped)

### Expected behavior

A visualization of the two integrated point clouds .

### Open3D, Python and System information

```markdown
- Operating system: Ubuntu 22.04
- Python version: import sys; print(sys.version)
- Open3D version: 0.16.1+54f38985f
- System architecture: x86 64-bit
- Is this a remote workstation?: no
- How did you install Open3D?: build from source
- Compiler version (if built from source): gcc 11.3.0
```

### Additional information

It starts working when adding the first 4 images