apache / apache/parquet-java

[C++] Unable to read parquetjs-created file using low-level parquet-cpp API

未关闭
#2,320 2 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
Component: Parquet Priority: Major Type: bug
主要语言
Java
星标
3.1k
派生
1.6k
平均合并
3 天 12 小时
30 天内合并 PR
33

描述

Follow-up to PARQUET-1482: basic support for reading Parquet files with Data page V2 pages was added as a part of PARQUET-1482.

 

However, this was only added to the higher-level Arrow API, and not to the lower-level Parquet API. We could port this fix to the lower-level API so that more users can read Parquet files with Data page V2 pages.

**Reporter**: [Rylan Dmello](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=rdmello) / @rdmello
**Assignee**: [Rylan Dmello](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=rdmello) / @rdmello
#### Related issues:
- [[C++] Implement support for DataPageV2](https://github.com/apache/arrow/issues/42256) (is caused by)
#### Original Issue Attachments:
- [all_types_gzip_02.parquet](https://issues.apache.org/jira/secure/attachment/12969016/all_types_gzip_02.parquet)
- [feeds1kMicros.parquet](https://issues.apache.org/jira/secure/attachment/12965514/feeds1kMicros.parquet)

**Note**: *This issue was originally created as [PARQUET-1560](https://issues.apache.org/jira/browse/PARQUET-1560). Please see the [migration documentation](https://issues.apache.org/jira/browse/PARQUET-2502) for further details.*

贡献指南

这个仓库没有索引到贡献指南

调研方向

从 PARQUET-1482 中添加的 Data page V2 支持开始,并比较较高层级的 Arrow API 实现与较低层级的 Parquet API。使用附带的由 parquetjs 创建的文件,验证较低层级的 API 能够读取 Data page V2 页面。

由索引模型根据 Issue 内容生成。

评估

技术栈
cpp
领域
databases
Issue 类型
功能
难度
4/5
预计耗时
3-5 天
活跃度
停滞
描述清晰度
基本清楚
新手友好度
35/100

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。