apache / apache/hudi

Implement support for applying updates as deletes + inserts

Open
#16,073 0 comments 0 reactions 1 assignee Assigned to @the-other-tim-brown View on GitHub
area:performance from-jira priority:high type:feature
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

This needs to happen at the higher layer of writing from Spark/Flink etc. 

Hudi can already support this, by 

- Logging delete blocks to the old file group. 
- Writing new data blocks/base files to the new file group.

## JIRA info

- Link: https://issues.apache.org/jira/browse/HUDI-6490
- Type: New Feature
- Epic: https://issues.apache.org/jira/browse/HUDI-3249
- Fix version(s):
- 1.1.0

---

## Comments

15/Aug/23 01:30;vinoth;[~tim.brown] Do you want to take this work up? This can be done even on the 0.X code line. ;;;

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.