apache / apache/fluss

[kv snapshot lease] Reduce the external IO operation when send source event to coordinator when FlinkSourceReader do snapshot state

Open
#2,597 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
2.1k
Forks
625
Avg merge
3d 14h
Merged PRs (30d)
97

Description

### Search before asking

- [x] I searched in the [issues](https://github.com/apache/fluss/issues) and found nothing similar.

### Motivation

Reduce the external IO operation when send source event to coordinator when FlinkSourceReader do snapshot state. See comment: https://github.com/apache/fluss/pull/2179#discussion_r2777638637

### Solution

_No response_

### Anything else?

_No response_

### Willingness to contribute

- [ ] I'm willing to submit a PR!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading FlinkSourceReader's snapshot state flow and the discussion linked from PR 2179. Trace how source events are sent to the coordinator and identify the external IO that can be avoided. Done means the snapshot path performs fewer external IO operations without changing coordinator behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
stream-processing
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.