apache / apache/parquet-java

[C++] Unable to read parquetjs-created file using low-level parquet-cpp API

Open
#2,320 2 comments 0 reactions 0 assignees View on GitHub
Component: Parquet Priority: Major Type: bug
Dominant language
Java
Stars
3.1k
Forks
1.6k
Avg merge
3d 12h
Merged PRs (30d)
33

Description

Follow-up to PARQUET-1482: basic support for reading Parquet files with Data page V2 pages was added as a part of PARQUET-1482.

 

However, this was only added to the higher-level Arrow API, and not to the lower-level Parquet API. We could port this fix to the lower-level API so that more users can read Parquet files with Data page V2 pages.

**Reporter**: [Rylan Dmello](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=rdmello) / @rdmello
**Assignee**: [Rylan Dmello](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=rdmello) / @rdmello
#### Related issues:
- [[C++] Implement support for DataPageV2](https://github.com/apache/arrow/issues/42256) (is caused by)
#### Original Issue Attachments:
- [all_types_gzip_02.parquet](https://issues.apache.org/jira/secure/attachment/12969016/all_types_gzip_02.parquet)
- [feeds1kMicros.parquet](https://issues.apache.org/jira/secure/attachment/12965514/feeds1kMicros.parquet)

**Note**: *This issue was originally created as [PARQUET-1560](https://issues.apache.org/jira/browse/PARQUET-1560). Please see the [migration documentation](https://issues.apache.org/jira/browse/PARQUET-2502) for further details.*

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with the Data page V2 support added under PARQUET-1482 and compare the higher-level Arrow API implementation with the lower-level Parquet API. Use the attached parquetjs-created files to verify that the lower-level API can read Data page V2 pages.

Written by the indexing model from the issue text.

Assessment

Tech stack
cpp
Domain
databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.