apache / apache/hudi

Debug if Insert operation calls upsert in case of small file handling path.

Open
#14,633 0 comments 0 reactions 1 assignee Claimed by @yihua View on GitHub
area:writer from-jira priority:high type:bug
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

INSERT operations may be triggering UPSERT internally in the Merging process when dealing with small files. This surfaced out of a SLACK thread. Need to config if this is indeed is happening. If yes, this needs to be fixed such that the MERGE HANDLE should not call upsert and instead let conflicting records into the file if it is an INSERT operation.

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-1145
- Type: Bug
- Affects version(s):
- 0.9.0
- Fix version(s):
- 1.1.0

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.