GoogleCloudPlatform / GoogleCloudPlatform/prometheus-engine

Additional buckets getting inserted with sum & rate/increase for histograms

Open
#316 1 comment 0 reactions 0 assignees View on GitHub
bug
Dominant language
Go
Stars
232
Forks
109
Avg merge
1d 3h
Merged PRs (30d)
27

Description

We're experiencing a weird issue with histogram buckets on a few of our GCP projects. The following query returns a different set of buckets on different projects, even though the config is the same:

```
sum(increase(nginx_ingress_controller_request_duration_seconds_bucket{exported_namespace=~"(production|staging)-receiving"}[5m])) by (le)
```

Running the above query on GCP project A returns the following buckets (note the added buckets):

CleanShot 2022-09-07 at 14 39 20@2x

Running it on GCP projects B + C returns the following buckets (note the additional buckets that get inserted):

CleanShot 2022-09-07 at 14 38 32@2x

This is only happening for a combination of `sum(increase(bucket)) by (le)` and `sum(rate(bucket)) by (le)`, but not for `sum(irate(bucket)) by (le)`.

Any idea what might be going on here?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.