apache / apache/fluss

[spark] Limit the scope and semantics of startup.mode

Open
#3,426 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
2.1k
Forks
625
Avg merge
3d 14h
Merged PRs (30d)
97

Description

### Search before asking

- [x] I searched in the [issues](https://github.com/apache/fluss/issues) and found nothing similar.

### Motivation

startup.mode should only be used in spark streaming scenario, never be used in batch read.

### Solution

_No response_

### Anything else?

_No response_

### Willingness to contribute

- [x] I'm willing to submit a PR!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the Spark integration code that handles startup.mode, then compare its streaming and batch-read paths. Confirm where the setting is currently accepted and add or adjust coverage for the intended streaming-only semantics. Done means startup.mode applies to Spark streaming and is not used in batch reads.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, spark
Domain
stream-processing
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
52/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.