apache / apache/paimon-rust

Support stream read with from-snapshot-full mode

Open
#807 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
197
Forks
92
Avg merge
1d 16h
Merged PRs (30d)
91

Description

### Search before asking

- [x] I searched in the [issues](https://github.com/apache/paimon-rust/issues) and found nothing similar.

### Motivation

Support streaming read with from-snapshot-full mode, where all write log entries (+I, +U, -D entries), including not-yet-compacted L0 data of DV tables, can be stably retrieved.

### Solution

_No response_

### Anything else?

_No response_

### Willingness to contribute

- [ ] I'm willing to submit a PR!

Contributor guide

Open the contributing guide

Research direction

The issue names no files, tests, or entry points. Start by locating the existing streaming-read and from-snapshot-full handling in the repository, then determine how DV-table L0 write-log entries should be exposed. Done should include stable retrieval of +I, +U, and -D entries, with tests covering the requested mode.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
data-engineering, stream-processing
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.