apache / apache/fluss

[flink] Support Union Read via Flink DataStream API

Open
#2,895 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
Java
Stars
2.1k
Forks
625
Avg merge
3d 14h
Merged PRs (30d)
97

Description

### Search before asking

- [x] I searched in the [issues](https://github.com/apache/fluss/issues) and found nothing similar.

### Description

Currently, Union Read (combining lake snapshot with Fluss log) is only supported through the Flink SQL/Table API. Users who use the DataStream API cannot leverage Union Read to read historical data from the data lake alongside real-time data from Fluss.

### Willingness to contribute

- [x] I'm willing to submit a PR!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by examining the existing Union Read support through the Flink SQL/Table API and the Flink DataStream API entry points. Determine how DataStream users can read historical lake snapshot data alongside real-time Fluss data, then verify that this workflow is supported end to end.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
stream-processing
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.