Need "realtimeRowsConsumed" metric for Low Level Consumer too
- Dominant language
- Java
- Stars
- 6.1k
- Forks
- 1.5k
- Avg merge
- 1d 21h
- Merged PRs (30d)
- 189
Description
Currently we are not seeing an aggregated per-host `realtimeRowsConsumed` metric when using LLC. That metric is useful because currently per-partition-per-table metric is too much detail meant for debugging.
It is possible to do metric aggregation to have this "per-host realtimeRowsConsumed" metric with some metric limit like the 250(450?) series in DataDog StatsD, it is not possible to get that many series into it.
Contributor guide
Research direction
No file or test is named. Start by locating Low Level Consumer metric emission and the existing per-partition-per-table realtimeRowsConsumed metric, then trace where aggregation could be added. Done means exposing an aggregated per-host realtimeRowsConsumed metric while keeping the metric-series volume within a practical limit such as the stated StatsD constraint.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- observability
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 38/100