apache / apache/hudi

merge into partial update should not need precombine field assignment for partial update

Open
#16,774 1 comment 0 reactions 0 assignees View on GitHub
from-jira priority:high type:bug
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

we should allow MIT delete clause to operate even if there is no precombine key specified in the source table in commit time ordering case.

 

Same for MIT partial update, regardless of the merge mode, if precombine key is absent from the source, we should fall back to commit time ordering and apply the change.

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-8852
- Type: Bug

Contributor guide

No contributing guide indexed for this repository

Research direction

No source files or tests are named. Start by locating Hudi's merge-into handling for partial updates and deletes, then review the linked JIRA issue and reproduce the commit-time ordering case. Done means changes without a source precombine field are applied for both MIT deletes and partial updates across merge modes.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
52/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.