apache / apache/iceberg-rust

Process delete files when writing snapshots

Open
#2,242 1 comment 0 reactions 0 assignees View on GitHub
enhancement stale
Dominant language
Rust
Stars
1.4k
Forks
567
Avg merge
2d 2h
Merged PRs (30d)
93

Description

### Is your feature request related to a problem or challenge?

Currently we don't have a way of generating delete file content when writing new snapshots. This will prevent us from implementing rewrite or delete transactions

### Describe the solution you'd like

A working version can be found here: https://github.com/apache/iceberg-rust/pull/1606/changes#diff-de4cef928aa029fb345044390081b5998c99c52e320a4046579c457c3b03a507

### Willingness to contribute

I can contribute to this feature independently

Contributor guide

Open the contributing guide

Research direction

The issue names no source files or tests. Start by reading the referenced iceberg-rust PR diff, then trace the snapshot-writing path to identify where delete file content should be generated. Done means a working implementation that supports the rewrite or delete transactions described in the issue.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.