Import fails with segmentation fault on MacOS within Anaconda environment

### Checklist

- [X] I have searched for [similar issues](https://github.com/isl-org/Open3D/issues).
- [X] For Python issues, I have tested with the [latest development wheel](http://www.open3d.org/docs/latest/getting_started.html#development-version-pip).
- [X] I have checked the [release documentation](http://www.open3d.org/docs/release/) and the [latest documentation](http://www.open3d.org/docs/latest/) (for `master` branch).

### Steps to reproduce the issue

#### I first cloned Open3D by:
```
conda env create -n open3d-test
conda activate opend3d-test
pip install open3d==0.17.0
python
import open3d
```

### Error message

```shell
[5] 35067 segmentation fault python
```
```

### Open3D, Python and System information

```markdown
- Operating system: macOS Ventura 13.3.1
- Python version: Python 3.10.10
- System architecture: apple-silicon
- Is this a remote workstation?: no
- How did you install Open3D?: pip within conda
```

### Additional information

It works fine when running outside Anaconda like this:
```
pip install open3d==0.17.0
python
import open3d
```