open3d.utility.Vector3dVector slow on headless rendering

**Describe the bug**
I built the source code according to the instructions [here](http://www.open3d.org/docs/latest/tutorial/Advanced/headless_rendering.html).
However, the `open3d.utility.Vector3dVector` gets slow on my self built library. It took ahout 60 ms. I'm aware of the solution posted in #1045. However, this does not work for my self built library. No matter whether convert my data to `np.float64` or not, it costs about the same time.

When I use the library installed with pip (0.13.0), it will only cost around 2ms for `np.float64` data.

**To Reproduce**
```
# points here is a ndarray with shape Nx4
point_cloud = open3d.geometry.PointCloud()
point_cloud.points = open3d.utility.Vector3dVector(points[:, :3].astype(np.float64)) # shoud be fast
```

**Expected behavior**
`open3d.utility.Vector3dVector(points[:, :3].astype(np.float64)) `to be fast

**Environment (please complete the following information):**

- Operating system: Ubuntu 18.04
- Python version: Anaconda Python 3.6.13
- Open3D version: 0.13.0+5e047b812
- Is this remote workstation?: yes
- How did you install Open3D?: build from source
- Compiler version (if built from source): gcc 7.5.0, no clang

**Additional context**
Does this has anything to do with the cmake options? I followed the instrtcions memtioned above and no other options set.