apache / apache/iceberg

Encryption integration with REST scan planning

Open
#16,192 0 comments 0 reactions 0 assignees View on GitHub
improvement
Dominant language
Java
Stars
9.2k
Forks
3.5k
Avg merge
2d 11h
Merged PRs (30d)
132

Description

### Feature Request / Improvement

See discussion in https://github.com/apache/iceberg/pull/13225#discussion_r2739557080. Lifting out from that thread and the TODO in that PR to a separate issue.

Iceberg encryption should integrate well with scan planning, though it might require encrypting file IO wrapping in certain places. Importantly, it's worth integration testing this too which can be tricky (see https://github.com/apache/iceberg/pull/15603).

### Query engine

None

### Willingness to contribute

- [ ] I can contribute this improvement/feature independently
- [ ] I would be willing to contribute this improvement/feature with guidance from the Iceberg community
- [ ] I cannot contribute this improvement/feature at this time

Contributor guide

Open the contributing guide

Research direction

Start with the discussion and TODO in pull request 13225, then review the integration-testing approach in pull request 15603. Determine the scan-planning and file-IO integration points, and verify completion with integration tests covering encryption during REST scan planning.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
api, security
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.