apache / apache/parquet-java

Deep verification of encrypted files

Open
#2,583 2 comments 0 reactions 0 assignees View on GitHub
Component: CLI Component: Parquet Priority: Major Type: enhancement
Dominant language
Java
Stars
3.1k
Forks
1.6k
Avg merge
3d 12h
Merged PRs (30d)
33

Description

A tools that verifies encryption of parquet files in a given folder. Analyzes the footer, and then every module (page headers, pages, column indexes, bloom filters) - making sure they are encrypted (in relevant columns). Potentially checking the encryption keys.

We'll start with a design doc, open for discussion.

**Reporter**: [Gidon Gershinsky](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=gershinsky) / @ggershinsky
**Assignee**: [Maya Anderson](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=mayaa) / @andersonm-ibm
#### PRs and other links:
- [Design doc](https://docs.google.com/document/d/1c6Vc2X2CPTReWG3aHoBhOBUJ7ghk80wTzcqs04bBDX8/edit?usp=sharing)

**Note**: *This issue was originally created as [PARQUET-1989](https://issues.apache.org/jira/browse/PARQUET-1989). Please see the [migration documentation](https://issues.apache.org/jira/browse/PARQUET-2502) for further details.*

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the linked design document, since the issue proposes beginning with design discussion and names no source files or tests. Define the verifier's scope and acceptance criteria for checking encrypted Parquet footers, modules, relevant columns, and potentially keys; done means the design is agreed before implementation begins.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
security, tooling
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.