cloudfoundry / cloudfoundry/prometheus-boshrelease

New App Latency and Requests Dashboards have no data

Open
#480 4 comments 0 reactions 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Shell
Stars
120
Forks
175
PR merge metrics
No merged PRs in 30d

Description

It appears that the HTTP related metrics (firehose_http_total and firehose_http_duration_seconds_sum) from the new firehose_exporter don't have the bosh_deployment tag present, so the dashboards for app latency and requests aren't showing any data unless I manually edit the query string to set "deploment" to empty string. The "Apps: System" dashboard does have data since the related metrics (firehose_container_metric_cpu_percentage for example) do have the bosh_deployment tag present.

I've confirmed that the raw metrics emitted on the firehose do appear to have the deployment property present and I can't tell why the tags are missing on just the HTTP metrics. Please let me know if this is something we have misconfigured.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

No file or test is named. Start by comparing the new firehose_exporter handling of firehose_http_total and firehose_http_duration_seconds_sum with firehose_container_metric_cpu_percentage, then inspect the raw firehose deployment property and the app latency and requests dashboard queries. Done means the HTTP metrics carry bosh_deployment and those dashboards show data without manually changing the query.

Written by the indexing model from the issue text.

Assessment

Tech stack
prometheus
Domain
observability
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.