prometheus-community / prometheus-community/stackdriver_exporter

Error 429: Query aborted. Please reduce the query rate.

Open
#304 3 comments 2 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Go
Stars
295
Forks
117
Avg merge
9d 14h
Merged PRs (30d)
7

Description

We are getting a few ...

ts=2024-01-29T10:29:44.926Z caller=monitoring_collector.go:212 level=error msg="Error while getting Google Stackdriver Monitoring metrics" err="googleapi: Error 429: Query aborted. Please reduce the query rate., rateLimitExceeded

Could you introduce an argument that allows a bit of sleep between API Calls to ease the pressure on the backend?

Probably somewhere here
https://github.com/prometheus-community/stackdriver_exporter/blob/master/collectors/monitoring_collector.go#L323

Google is looking into it as we don't seem to be hitting our quotas
However after making changes to your source, adding a slight delay between api calls seem to help

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start in collectors/monitoring_collector.go around line 323 and trace how monitoring API calls are issued. Determine where a configurable delay between calls can be applied without changing collection behavior. Done means the exporter accepts the new argument and the delay reduces the query rate; the issue reports no specific test file to run.

Written by the indexing model from the issue text.

Assessment

Tech stack
go, google-cloud, prometheus
Domain
observability
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.