apache / apache/pulsar

API to allow access to raw message for TableView

Open
#24,744 0 comments 0 reactions 0 assignees View on GitHub
type/enhancement
Dominant language
Java
Stars
15.3k
Forks
3.8k
Avg merge
1d 14h
Merged PRs (30d)
160

Description

### Search before reporting

- [x] I searched in the [issues](https://github.com/apache/pulsar/issues) and found nothing similar.

### Motivation

We use message properties to enable client side message filtering.

However this means we cannot use table view, as it only provides access to the de-serialized message.

### Solution

An API to allow access to raw message object in combination with table view

### Alternatives

Currently using a reader to find the last message ID, then re-reading from the beginning until that message ID.

### Anything else?

_No response_

### Are you willing to submit a PR?

- [ ] I'm willing to submit a PR!

Contributor guide

Open the contributing guide

Research direction

Start by reading the TableView API and tracing where it currently exposes only the deserialized message. Compare that path with the raw message access available to readers, then define and test the TableView API behavior needed to expose message properties while preserving existing consumers.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
backend-api-design, distributed-systems
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.