Problem with the 3D reconstruction when I rotate the camera view.

### Checklist

- [X] I have searched for [similar issues](https://github.com/isl-org/Open3D/issues).
- [X] For Python issues, I have tested with the [latest development wheel](http://www.open3d.org/docs/latest/getting_started.html#development-version-pip).
- [X] I have checked the [release documentation](http://www.open3d.org/docs/release/) and the [latest documentation](http://www.open3d.org/docs/latest/) (for `master` branch).

### My Question

When I perform translation everything is fine 3d reconstruction is also perfect but when I rotate the agent then the environment is elongated and therefore my whole 3d reconstruction results overlappe with each other.

https://user-images.githubusercontent.com/33871656/165308271-b639cb74-881d-4ea0-9667-a6b712d0af2f.mp4

You can see in the video, that at the beginning, I only used translation and everything was fine but when I rotate the camera everything is overlapped and 3D reconstruction doesn't work well.
When I translate the camera in (X, Y, Z) direction there is no problem