apache / apache/parquet-format

Introduce FSST Support for Parquet

Open
#531 2 comments 1 reaction 0 assignees View on GitHub
Type: enhancement
Dominant language
Thrift
Stars
2.6k
Forks
508
Avg merge
2d 8h
Merged PRs (30d)
4

Description

### Describe the enhancement requested

Tracks the support for FSST for byte array in Parquet format
Proposal: https://docs.google.com/document/d/1g7zgopxeHc5nofJXfc8EEp_HGMaI8g-jFVvNCs2GVA0/edit?tab=t.0#heading=h.2eyxl5kkyzy7

Contributor guide

Open the contributing guide

Research direction

Start by reading the linked FSST proposal and the Parquet format specification to understand the requested byte-array support. The issue names no implementation files or tests, so identify the relevant format definitions and compatibility requirements before planning work. Done means the Parquet format explicitly supports FSST for byte arrays with accompanying validation or specification coverage.

Written by the indexing model from the issue text.

Assessment

Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.