apache / apache/arrow-rs

[Epic] Parquet Modular Encryption Support

Open
#7,278 2 comments 0 reactions 0 assignees View on GitHub
enhancement parquet
Dominant language
Rust
Stars
3.6k
Forks
1.3k
Avg merge
2d 14h
Merged PRs (30d)
167

Description

This ticket tracks the work to implement [Parquet Modular Encryption](https://github.com/apache/parquet-format/blob/master/Encryption.md)

See the prior discussion / question here:
- https://github.com/apache/arrow-rs/issues/3511

Related items
- [x] https://github.com/apache/arrow-rs/issues/7296
- [x] https://github.com/apache/datafusion-comet/issues/1040
- [x] https://github.com/apache/parquet-site/pull/107
- [x] https://github.com/apache/arrow-rs/pull/6637
- [x] https://github.com/apache/arrow-rs/issues/7327
- [ ] https://github.com/apache/arrow-rs/issues/7258
- [x] https://github.com/apache/arrow-rs/issues/7255
- [x] https://github.com/apache/arrow-rs/issues/7257
- [ ] ~https://github.com/apache/arrow-rs/issues/7256~
- [x] https://github.com/apache/arrow-rs/issues/7280
- [x] https://github.com/apache/arrow-rs/issues/7281
- [x] https://github.com/apache/arrow-rs/issues/7390
- [x] https://github.com/apache/arrow-rs/issues/7320
- [x] https://github.com/apache/arrow-rs/pull/7600
- [x] #7359
- [x] #8304
- [x] #8115
- [ ] #7373
- [ ] #8238

Contributor guide

Open the contributing guide

Research direction

Read the Parquet Modular Encryption specification in Encryption.md and the prior discussion in apache/arrow-rs#3511. Review the checked and unchecked related issues and pull requests to identify remaining work; the epic is complete when the outstanding items are addressed.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
security
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.