apache / apache/hudi

Use bulk insert for the first write to an empty Hudi table

Open
#15,682 0 comments 0 reactions 0 assignees View on GitHub
from-jira priority:critical type:improvement
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

For the first batch to an empty table, given no tagging/indexing is needed, we can always use bulk insert (regardless of what's specified as operation type such as INSERT, UPSERT) to improve the write performance with reasonable file sizing.

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-5546
- Type: Improvement

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue names no files, tests, or entry points. Start by locating the empty-table write path and existing bulk-insert handling; done means the first batch uses bulk insert when the table is empty and no tagging or indexing is needed, regardless of the requested operation type, with the expected file sizing and performance preserved.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.