apache / apache/hudi

Make sure Hudi always does bulk-insert during the first commit into the table

Open
#15,259 0 comments 0 reactions 1 assignee Assigned to @xushiyan View on GitHub
area:performance area:writer from-jira priority:critical type:bug
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

As a follow-up to the recent discussions in the community regarding out-of-the-box configuration (DB blog), i think we should adjust some aspects of our OOB configuration to stay in-line with other formats as it's inevitable that people would be comparing Hudi's performance against Delta and Iceberg:

For example, we should make sure that whenever someone is creating a table from scratch we always use "bulk_insert" instead of "upsert" as there's no reason for us to incur the overhead of upserting since we know the table was empty.

 

It could roughly go as following:
* If the table is empty, and
* There's no explicit operation configured, and
* There's no pre-combining configured

Then we treat it as "bulk_insert" case 

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-4368
- Type: Bug
- Fix version(s):
- 1.1.0

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.