prometheus-community / prometheus-community/stackdriver_exporter

Internal server error for custom metrics

Open
#37 1 comment 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Go
Stars
295
Forks
117
Avg merge
9d 14h
Merged PRs (30d)
7

Description

I have some user-defined metrics in stackdriver (in particular, for dataflow) that I am having trouble exporting. When I set the environment variable STACKDRIVER_EXPORTER_MONITORING_METRICS_TYPE_PREFIXES
to, for example bigtable.googleapis.com/cluster, everything works fine and I am able to see my metrics in Prometheus. However, when I instead set it to bigtable.googleapis.com/cluster,custom.googleapis.com, I get 500s when I attempt to get metrics.

HTTP request sent, awaiting response... 500 Internal Server Error
2018-10-03 18:59:19 ERROR 500: Internal Server Error.

Has anyone been able to successfully export custom metrics, and if so how?

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by reproducing the scrape with STACKDRIVER_EXPORTER_MONITORING_METRICS_TYPE_PREFIXES set to both the working Bigtable prefix and custom.googleapis.com. Inspect the exporter’s handling of that environment variable and the scrape response or logs; done means custom metrics are exported successfully without an HTTP 500.

Written by the indexing model from the issue text.

Assessment

Tech stack
go, google-cloud, prometheus
Domain
observability
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.