hiero-ledger / hiero-ledger/hiero-consensus-node

Events Per Second Gauge Threshold Update on Network Details Dashboard

Open
#11,641 0 comments 0 reactions 0 assignees View on GitHub
Observability Platform
Dominant language
Java
Stars
406
Forks
226
Avg merge
3d 4h
Merged PRs (30d)
210

Description

### Problem

The EPS (Events Per Second) Gauge on https://production.grafana.hedera-ops.com/d/network-details-prom/network-details-prometheus?orgId=1&refresh=5s is showing red at 360 EPS and @poulok suggested we may need to have the thresholds updated.

source: https://swirldslabs.slack.com/archives/C03DN7L1T1A/p1708449989025329

### Solution

We are still working out the exact thresholds but here is a proposition for now:

https://production.grafana.hedera-ops.com/d/network-details-prom/network-details-prometheus?orgId=1&refresh=5s
https://github.com/hashgraph/hedera-services/blob/4d9be0519a419c44877459d3bb2df60f9292ba47/hedera-node/infrastructure/grafana/dashboards/production/hedera-node/network-details-prom.json#L816-L879

* Enable "Show Threshold Labels"
* Display name "events per second" ??
* Threshold changes
* Base = red
* 80 = yellow
* 280 = green
* Set max to 580 (for 29 node network, at 20 events/sec per node, possibly calculate this per total nodes)
* Set min to 0
* Show threshold labels: false
* Show threshold markers: true

![image](https://github.com/hashgraph/hedera-services/assets/1504756/61f870fd-71f0-457d-90f7-fa311a6ba892)

### Alternatives

_No response_

Contributor guide

Open the contributing guide

Research direction

Inspect hedera-node/infrastructure/grafana/dashboards/production/hedera-node/network-details-prom.json around lines 816-879 and compare the panel with the linked Network Details dashboard. Confirm the final threshold and label settings with maintainers, since the issue contains conflicting label instructions. Done means the agreed EPS thresholds and gauge display are reflected in the dashboard and verified visually.

Written by the indexing model from the issue text.

Assessment

Tech stack
grafana
Domain
observability
Issue type
Bug
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.