apache / apache/auron

Add AES_GCM_CTR_V1 encryption support for Parquet

Open
#2,477 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
1.8k
Forks
241
Avg merge
2d 12h
Merged PRs (30d)
21

Description

**Is your feature request related to a problem? Please describe.**
Our cluster contains Parquet tables encrypted with the AES_GCM_CTR_V1 algorithm, but Auron is currently unable to decrypt and read them.

**Describe the solution you'd like**
Implement AES_GCM_CTR_V1 support in the upstream arrow-rs library for reading and writing Parquet files encrypted with the CTR algorithm.The algorithm is implemented using the aws-lc-rs library and currently supports only 128-bit keys.

**Reference issues**
https://github.com/apache/arrow-rs/issues/7258

Contributor guide

Open the contributing guide

Research direction

Start with the referenced upstream arrow-rs issue, #7258, to understand the implementation scope and where Parquet encryption support belongs. The requested change is AES_GCM_CTR_V1 support for reading and writing encrypted Parquet files, implemented with aws-lc-rs and 128-bit keys; done means Auron can read those files and write them.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
cryptography, databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.