Add AES_GCM_CTR_V1 encryption support for Parquet
- Dominant language
- Rust
- Stars
- 1.8k
- Forks
- 241
- Avg merge
- 2d 12h
- Merged PRs (30d)
- 21
Description
**Is your feature request related to a problem? Please describe.**
Our cluster contains Parquet tables encrypted with the AES_GCM_CTR_V1 algorithm, but Auron is currently unable to decrypt and read them.
**Describe the solution you'd like**
Implement AES_GCM_CTR_V1 support in the upstream arrow-rs library for reading and writing Parquet files encrypted with the CTR algorithm.The algorithm is implemented using the aws-lc-rs library and currently supports only 128-bit keys.
**Reference issues**
https://github.com/apache/arrow-rs/issues/7258
Contributor guide
Research direction
Start with the referenced upstream arrow-rs issue, #7258, to understand the implementation scope and where Parquet encryption support belongs. The requested change is AES_GCM_CTR_V1 support for reading and writing encrypted Parquet files, implemented with aws-lc-rs and 128-bit keys; done means Auron can read those files and write them.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- cryptography, databases
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 48/100