apache / apache/parquet-format
Introduce FSST Support for Parquet
- Dominant language
- Thrift
- Stars
- 2.6k
- Forks
- 508
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 4
Description
### Describe the enhancement requested
Tracks the support for FSST for byte array in Parquet format
Proposal: https://docs.google.com/document/d/1g7zgopxeHc5nofJXfc8EEp_HGMaI8g-jFVvNCs2GVA0/edit?tab=t.0#heading=h.2eyxl5kkyzy7
Contributor guide
Research direction
Start by reading the linked FSST proposal and the Parquet format specification to understand the requested byte-array support. The issue names no implementation files or tests, so identify the relevant format definitions and compatibility requirements before planning work. Done means the Parquet format explicitly supports FSST for byte arrays with accompanying validation or specification coverage.
Written by the indexing model from the issue text.
Assessment
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100