Slow Composition and Unnecessary Recompositing of Google Maps with Custom Clusters

I've used Google Maps on XML (Views) with Cluster Manger with my customization. I decided to migrate to Compose Maps and Custom Clusters, I'm still using View-based Cluster Manager, but that doesn't affect my issue.

The issue is, that the map loads slowly on Composable Screen, one of the Bottom navigation screens.
Every navigation from another screen and coming back to the same map screen reloads the map, but the markers are loaded on time. I've already handled it. The map looks like a mesh grid some of the time, clustering markers take a couple of seconds and lag for second as well, and after that, it works smoothly.
Unlike Views, it's not caching the map and the markers well, is there any workaround?