apache / apache/hudi

OOM caused by configuring read.start_commit as earliest in stream reading

Open
#16,262 2 comments 0 reactions 0 assignees View on GitHub
area:reader from-jira priority:medium status:pr-available type:improvement
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-6971
- Type: Improvement

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading the linked HUDI-6971 issue, since this report does not name files, tests, or an entry point. Trace how stream reading handles read.start_commit when it is configured as earliest, then verify that this configuration no longer causes an out-of-memory condition and add or update coverage for the behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
performance, stream-processing
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.