apache / apache/iceberg-python
Support Snapshot Management Operations
- Dominant language
- Python
- Stars
- 1.1k
- Forks
- 581
- Avg merge
- 1d 17h
- Merged PRs (30d)
- 77
Description
### Feature Request / Improvement
Following is a list of operations that are supported in Spark:
- rollback_to_snapshot (set_ref_snapshot)
- rollback_to_timestamp (set_ref_snapshot)
- set_current_snapshot (set_ref_snapshot)
- cherrypick_snapshot
- publish_changes
- fast_forward
[set_ref_snapshot](https://github.com/apache/iceberg-python/pull/728) support will be introduced, but it would also be nice to add snapshot migration operations that generate new snapshots from existing ones
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reviewing the set_ref_snapshot work linked in the issue and the existing snapshot-management operations in PyIceberg. Compare the listed Spark operations with the project's current API and determine the intended behavior and tests for each migration operation. Done means the supported operations generate the expected snapshots and are covered by tests.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data-engineering, databases
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100