apache / apache/pulsar-helm-chart

No data shown in Grafana Dashboards

Open
#468 9 comments 0 reactions 0 assignees View on GitHub
Dominant language
Shell
Stars
240
Forks
260
Avg merge
4h 12m
Merged PRs (30d)
1

Description

I noticed that I don't see any data in my Grafana Dashboards. I hoped for this problem to be fixed after updating to the latest version of the chart (3.0.0. -> 3.3.0) but it persists ever since. All dashboards are showing no data.

I checked Grafanas settings and see that a Prometheus datasource is configured (http://pulsar-kube-prometheus-sta-prometheus.default:9090). If I click on "Test" to test the connection, I receive "Succesfully queried the Prometheus API".

After that I opened the Prometheus UI and checked the configuration under http://prometheus-address:9090/config. In it I see a bunch of jobs related to Pulsar:
```
job_name: podMonitor/default/pulsar-zookeeper/0
job_name: podMonitor/default/pulsar-proxy/0
job_name: podMonitor/default/pulsar-broker/0
job_name: podMonitor/default/pulsar-bookie/0
```
Looking up the Metrics Explorer I can't see any Pulsar related metrics.

I'll post here my values.yaml:

```
clusterName: cluster-a
namespace: pulsar
namespaceCreate: false
initialize: false

auth:
authentication:
enabled: true
jwt:
usingSecretKey: false
provider: jwt
authorization:
enabled: true
superUsers:
broker: broker-admin
client: admin
proxy: proxy-admin

broker:
configData:
proxyRoles: proxy-admin

certs:
internal_issuer:
enabled: true
type: selfsigning

components:
pulsar_manager: false

tls:
broker:
enabled: true
enabled: true
proxy:
enabled: true
zookeeper:
enabled: true
```

I installed the Pulsar helm chart into a namespace "pulsar" and noticed that all Grafana-Stack related components were installed into the "default" namespace.

Could this be an issue?
I also enabled authentication/authorization, maybe the issue has to do with that?

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the provided values.yaml and compare the Grafana datasource, Prometheus configuration, and deployed namespaces for the Pulsar monitoring components. Check the Prometheus Metrics Explorer for Pulsar metrics and verify that the Grafana dashboards display data while authentication and authorization remain enabled.

Written by the indexing model from the issue text.

Assessment

Tech stack
grafana, helm, kubernetes, prometheus
Domain
infrastructure, observability-sre
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.