apache / apache/iceberg-python

[Feat] Support Merge-on-Read mode for Deletes

Open
#1,078 7 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.1k
Forks
581
Avg merge
1d 17h
Merged PRs (30d)
78

Description

### Feature Request / Improvement

Similar to Spark, we would like to implement Merge-on-Read mode of deleting, by creating delete files that encode position and equality delete markers that can be applied within a given partition.

https://iceberg.apache.org/spec/?h=delete+files#row-level-deletes

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading the Apache Iceberg row-level deletes specification linked in the issue, then compare its position and equality delete requirements with the existing PyIceberg deletion behavior. Define the supported Merge-on-Read scope and verify that delete markers can be applied within a partition, including tests for both delete types.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, spark
Domain
data-engineering, databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.