apache / apache/pulsar

We need a size limit for cache of single managedLeger

Open
#22,621 2 comments 1 reaction 0 assignees View on GitHub
type/enhancement
Dominant language
Java
Stars
15.3k
Forks
3.8k
Avg merge
1d 14h
Merged PRs (30d)
160

Description

### Search before asking

- [X] I searched in the [issues](https://github.com/apache/pulsar/issues) and found nothing similar.

### Motivation

When a topic produce too much messages, the caches of broker will be full with this topic. In this case, the fetch request of other consumers cannot hit the cache and they only can read entries by bookeeper.

### Solution

Add a size limit for cache of single managedLedger.

### Alternatives

~

### Anything else?

~

### Are you willing to submit a PR?

- [X] I'm willing to submit a PR!

Contributor guide

Open the contributing guide

Research direction

Start by tracing the broker cache and ManagedLedger cache implementation and its configuration points; the issue does not name files or tests. Compare how cache usage is tracked per managed ledger and identify existing cache-related tests. Done means a single managed ledger has an enforced size limit so other consumers can still use the broker cache.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
backend, distributed-systems
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.