apache / apache/iceberg-python
[feat] add missing metadata tables
- Dominant language
- Python
- Stars
- 1.1k
- Forks
- 581
- Avg merge
- 1d 17h
- Merged PRs (30d)
- 78
Description
### Feature Request / Improvement
Looks like there are a few more metadata tables currently missing in PyIceberg.
Source of truth for metadata tables: https://iceberg.apache.org/javadoc/latest/org/apache/iceberg/MetadataTableType.html
Done: https://py.iceberg.apache.org/api/#inspecting-tables
- [x] SNAPSHOTS
- [x] PARTITIONS
- [x] ENTRIES
- [x] REFS
- [x] MANIFESTS
- [x] METADATA_LOG_ENTRIES
- [x] HISTORY
- [x] FILES
Missing:
- [x] ALL_DATA_FILES
- [x] ALL_DELETE_FILES
- [ ] ALL_ENTRIES
- [x] ALL_FILES
- [x] ALL_MANIFESTS
- [x] DATA_FILES
- [x] DELETE_FILES
- [ ] POSITION_DELETES
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with PyIceberg's table-inspection entry point documented at https://py.iceberg.apache.org/api/#inspecting-tables, then compare its supported metadata tables with the Apache Iceberg MetadataTableType source of truth. Done means ALL_ENTRIES and POSITION_DELETES are supported alongside the already listed metadata tables.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data-engineering, databases
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Quiet
- Clarity
- Mostly clear
- Newbie friendliness
- 66/100