[Bug] PointCloudLayer The size of the points changes after rotate

Description

PointCloudLayer - Sometimes when you do some manipulations with the map (point Cloud): zoom out, zoom in, rotate -

1. The points disappear (after zoom in)
2. The dots become larger or smaller
   Is this a bug and can it be fixed? thank you

I am attaching screenshots and a video with reproduction from an official example
https://deck.gl/examples/point-cloud-layer to the Steps to Reproduce

Flavors

• Script tag
• React
• Python/Jupyter notebook
• MapboxOverlay
• GoogleMapsOverlay
• CartoLayer
• ArcGIS

Expected Behavior

When changing the size of the map and its rotation, the sizes of the points do not change

Steps to Reproduce

1 Rotate the map (cloud points)
2 Zoom in the map
3 Zoom out the map
4 Rotate the map around the axis
5 Zoom in the map to its original size

1. The dots disappear or their size becomes very small
   https://github.com/visgl/deck.gl/assets/10815947/fec03be3-b769-4b3e-92e6-4056918c4186

2. The dots get bigger
   Before:
   
   After:
   

Environment

• Framework version: -
• Browser: Google Chrome 114.0.5735.106 (64)
• OS: Ubuntu 22.04.02 LTS

Logs

No response

Start with the official PointCloudLayer example linked in the issue and reproduce the rotate and zoom sequence in Chrome. Trace the PointCloudLayer rendering and viewport handling involved in that example; done means points remain visible and retain their size after the reported manipulations.