apache / apache/iceberg-python

Support Snapshot Management Operations

Open
#737 8 comments 5 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.1k
Forks
581
Avg merge
1d 17h
Merged PRs (30d)
77

Description

### Feature Request / Improvement

Following is a list of operations that are supported in Spark:
- rollback_to_snapshot (set_ref_snapshot)
- rollback_to_timestamp (set_ref_snapshot)
- set_current_snapshot (set_ref_snapshot)
- cherrypick_snapshot
- publish_changes
- fast_forward

[set_ref_snapshot](https://github.com/apache/iceberg-python/pull/728) support will be introduced, but it would also be nice to add snapshot migration operations that generate new snapshots from existing ones

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing the set_ref_snapshot work linked in the issue and the existing snapshot-management operations in PyIceberg. Compare the listed Spark operations with the project's current API and determine the intended behavior and tests for each migration operation. Done means the supported operations generate the expected snapshots and are covered by tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data-engineering, databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.