prometheus-community / prometheus-community/stackdriver_exporter

Stackdriver crashing on unkown series

Open
#104 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Go
Stars
295
Forks
117
Avg merge
9d 14h
Merged PRs (30d)
7

Description

Seems like those series aren't documented anywhere, they're searchable in the metrics explorer though.

level=info ts=2020-07-23T15:07:06.333Z caller=stackdriver_exporter.go:161 msg="Starting stackdriver_exporter" version="(version=0.10.0, branch=HEAD, revision=b52e21b38d2968eb1de34736a7c1c3c888c660b8)"
level=info ts=2020-07-23T15:07:06.333Z caller=stackdriver_exporter.go:162 msg="Build context" build_context="(go=go1.14.4, user=root@e0fc7c146b68, date=20200629-08:31:06)"
level=info ts=2020-07-23T15:07:06.333Z caller=stackdriver_exporter.go:163 msg="Using Google Cloud Project ID" projectID=
level=info ts=2020-07-23T15:07:06.333Z caller=stackdriver_exporter.go:184 msg="Listening on" address=:9255
level=error ts=2020-07-23T15:07:08.191Z caller=monitoring_collector.go:252 msg="error retrieving Time Series metrics for descriptor" descriptor=compute.googleapis.com/internal_lb_forwarding_rules_per_vpc_network err="googleapi: Error 400: The supplied filter does not specify a valid combination of metric and monitored resource descriptors. The query will not return any time series., badRequest"
level=error ts=2020-07-23T15:07:08.213Z caller=monitoring_collector.go:252 msg="error retrieving Time Series metrics for descriptor" descriptor=compute.googleapis.com/ip_aliases_per_vpc_network err="googleapi: Error 400: The supplied filter does not specify a valid combination of metric and monitored resource descriptors. The query will not return any time series., badRequest"
level=error ts=2020-07-23T15:07:08.213Z caller=monitoring_collector.go:252 msg="error retrieving Time Series metrics for descriptor" descriptor=compute.googleapis.com/internal_protocol_forwarding_rules_per_vpc_network err="googleapi: Error 400: The supplied filter does not specify a valid combination of metric and monitored resource descriptors. The query will not return any time series., badRequest"
level=error ts=2020-07-23T15:07:08.230Z caller=monitoring_collector.go:252 msg="error retrieving Time Series metrics for descriptor" descriptor=compute.googleapis.com/instances_per_vpc_network err="googleapi: Error 400: The supplied filter does not specify a valid combination of metric and monitored resource descriptors. The query will not return any time series., badRequest"
level=error ts=2020-07-23T15:07:09.200Z caller=monitoring_collector.go:252 msg="error retrieving Time Series metrics for descriptor" descriptor=compute.googleapis.com/subnet_ranges_per_vpc_network err="googleapi: Error 400: The supplied filter does not specify a valid combination of metric and monitored resource descriptors. The query will not return any time series., badRequest"
level=error ts=2020-07-23T15:07:09.202Z caller=monitoring_collector.go:252 msg="error retrieving Time Series metrics for descriptor" descriptor=compute.googleapis.com/psc_google_apis_forwarding_rules_per_vpc_network err="googleapi: Error 400: The supplied filter does not specify a valid combination of metric and monitored resource descriptors. The query will not return any time series., badRequest"
level=error ts=2020-07-23T15:07:09.659Z caller=monitoring_collector.go:186 msg="Error while getting Google Stackdriver Monitoring metrics" err="googleapi: Error 400: The supplied filter does not specify a valid combination of metric and monitored resource descriptors. The query will not return any time series., badRequest"

Args:

            - "--monitoring.metrics-type-prefixes=\
            appengine.googleapis.com/,\
            autoscaler.googleapis.com/,\
            bigquery.googleapis.com/,\
            bigtable.googleapis.com/,\
            cloudsql.googleapis.com/,\
            compute.googleapis.com/,\
            dataflow.googleapis.com/,\
            loadbalancing.googleapis.com/,\
            monitoring.googleapis.com/,\
            pubsub.googleapis.com/,\
            redis.googleapis.com/,\
            router.googleapis.com/,\
            spanner.googleapis.com/,\
            storage.googleapis.com/"

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start in monitoring_collector.go, especially the metric retrieval path reported at line 252, and compare it with the startup configuration in stackdriver_exporter.go. Reproduce the issue with the listed --monitoring.metrics-type-prefixes and the unknown compute.googleapis.com descriptors. Done means the exporter handles the invalid metric/resource combinations without crashing or emitting the reported retrieval failure.

Written by the indexing model from the issue text.

Assessment

Tech stack
go, google-cloud
Domain
cloud, observability-sre
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
28/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.