Validate and simplify FG buffer merge logic
Open
from-jira
priority:high
type:bug
- Dominant language
- Java
- Stars
- 6.2k
- Forks
- 2.5k
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 111
Description
For example,
# payload vs merger
# delete in between for event time ordering.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-9201
- Type: Bug
- Affects version(s):
- 1.1.0
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with JIRA HUDI-9201 and trace the FG buffer merge path involving the payload and merger. Reproduce the event-time ordering case with a delete between events, then validate and simplify the merge logic so that this case behaves correctly.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100