Custom metrics adapter spewing errors "apiserver was unable to write a fallback JSON response: http2: stream closed"

GKE version: `1.23.14-gke.1800`
metrics adapter version: `gcr.io/gke-release/custom-metrics-stackdriver-adapter:v0.12.2-gke.0`

Adapter was installed via:
https://raw.githubusercontent.com/GoogleCloudPlatform/k8s-stackdriver/master/custom-metrics-stackdriver-adapter/deploy/production/adapter_new_resource_model.yaml

This doesn't throw an error: `kubectl get --raw "/apis/custom.metrics.k8s.io/v1beta1"`

But its spewing these errors:

I saw in some github issues people saying it was lack of resources but when I look at the metrics it seems well under utilized:

I don't think its failing to read metrics, but these errors are filling up my logs and they concern me.