[C++][Parquet] Should we support PARQUET_2_8 version?
Open
Component: C++
Component: Parquet
Type: enhancement
- Dominant language
- C++
- Stars
- 17.1k
- Forks
- 4.3k
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 91
Description
### Describe the enhancement requested
Nowadays, we support BYTE_STREAM_SPLIT in parquet. However, during writing, our highest format is PARQUET_2_6. So, do we need to support Parquet 2.8 or higher version
Changelogs: https://github.com/apache/parquet-format/blob/master/CHANGES.md#version-280
### Component(s)
C++, Parquet
Contributor guide
Research direction
Start with the Parquet 2.8 changelog linked in the issue and review the C++ Parquet writer's current PARQUET_2_6 handling. Determine which version changes affect BYTE_STREAM_SPLIT and define the compatibility and validation requirements; done means the project has a decided, validated support plan.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- data-engineering, databases
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100