apache / apache/hudi

MOR table log file write in append mode or update mode?

Open
#18,081 1 comment 0 reactions 0 assignees View on GitHub
type:community-support
Dominant language
Java
Stars
6.2k
Forks
2.5k
Avg merge
2d 8h
Merged PRs (30d)
111

Description

For the MOR table,

There is record (id = 1 , name = A0) in the base parquet file, then
1. I update the record, the record will write to the log file(id=1, name=A1),
2. I update the record again,id=1,name=A2,

My question is id=1,name=A1 and id=1,name=A2 are in the same log file(append write)? OR id=1,name=A2 overwrite id=1,name=A1, that is, id=1,name=A2 will update id=1,name=A1 in place?

Contributor guide

No contributing guide indexed for this repository

Research direction

No file, test, or entry point is named. Start by locating the MOR table write path and its log-file documentation, then verify how repeated updates are stored; done means documenting a definitive answer for the append-versus-in-place question.

Written by the indexing model from the issue text.

Assessment

Domain
data-engineering, distributed-systems
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.