apache / apache/iceberg-python

Feature Request: Encryption

Open
#3,222 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.1k
Forks
581
Avg merge
1d 17h
Merged PRs (30d)
78

Description

### Feature Request / Improvement

Apache Iceberg supports table encryption (https://iceberg.apache.org/docs/nightly/encryption/), and engines like Spark are capable now of writing and reading tables that adhere to Iceberg's encryption model.

This feature tracks PyIceberg supporting this. The eventual goal here would be (1) PyIceberg being able to read tables written by other engines according to Iceberg's encryption model, and (2) PyIceberg being able to write tables according to the encryption model, to be read by other engines. There's also the dimension of catalog support - on the Java side, Hive encryption is implemented and [REST encryption](https://github.com/apache/iceberg/pull/13225) will hopefully be soon.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the Apache Iceberg encryption documentation and compare its model with the Spark interoperability described here, then review the linked Hive and REST catalog encryption references. Done would mean PyIceberg can read and write tables following the encryption model and address the catalog-support dimension.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, spark
Domain
databases, security
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.