apache / apache/pulsar

should we add a metrics to show the top storage in bookeeper

Open
#13,718 3 comments 0 reactions 0 assignees View on GitHub
lifecycle/stale Stale type/feature
Dominant language
Java
Stars
15.3k
Forks
3.8k
Avg merge
1d 14h
Merged PRs (30d)
160

Description

**Is your feature request related to a problem? Please describe.**
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]

pulsar_storage_size only shows The total storage size of the topics in this namespace owned by this broker (bytes).

sometimes, if the topic was not loaded by brokers, maybe producers and consumers do not connect with any broker.

but they produced the most messages. we want to know, which topic/namespace/ tenant use the most disk in bookkeeper

**Describe the solution you'd like**
A clear and concise description of what you want to happen.

maybe we can read the zookeeper of the broker to analyze the ledger ids of a topic, then read the leger info in the zookeeper of the bookkeeper and sum them up。

**Describe alternatives you've considered**
A clear and concise description of any alternative solutions or features you've considered.

**Additional context**
Add any other context or screenshots about the feature request here.

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the existing pulsar_storage_size metric and the ZooKeeper metadata for broker topics and BookKeeper ledgers. Clarify whether the result should rank topics, namespaces, tenants, or all three, and define how ledger sizes are aggregated. Done means an agreed metric design that identifies the largest storage users.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
backend, observability
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.