apache / apache/parquet-java

remove deprecated PathGlobPattern and DeprecatedFieldProjectionFilter to compile on hadoop 3.2+

未关闭
#2,698 1 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
Component: Parquet Component: Thrift Priority: Major Type: enhancement
主要语言
Java
星标
3.1k
派生
1.6k
平均合并
3 天 12 小时
30 天内合并 PR
33

描述

remove the deprecated PathGlobPattern class and its uses from parquet-thrift

The return types from the hadoop GlobPattern code changed in HADOOP-12436; in the class as is will not compile against hadoop 3.x

Parquet releases compiled against hadoop 2.x will not be able to instantiate these classes on a hadoop 3 release, because things will not link.

Nobody appears to have complained about the linkage problem to the extent of filing a JIRA.

**Reporter**: [Steve Loughran](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=stevel@apache.org) / @steveloughran
#### Related issues:
- [Upgrade Hadoop dependency to version 3.2.0](https://github.com/apache/parquet-java/issues/2695) (is related to)

**Note**: *This issue was originally created as [PARQUET-2165](https://issues.apache.org/jira/browse/PARQUET-2165). Please see the [migration documentation](https://issues.apache.org/jira/browse/PARQUET-2502) for further details.*

贡献指南

这个仓库没有索引到贡献指南

调研方向

首先在 parquet-thrift 下定位 PathGlobPattern、DeprecatedFieldProjectionFilter 及其使用位置,然后检查 Hadoop GlobPattern API 和 Hadoop 3.2 依赖项变更。移除已弃用的类和引用,并验证 parquet-thrift 能够针对 Hadoop 3.2 或更高版本进行编译。

由索引模型根据 Issue 内容生成。

评估

技术栈
hadoop, java
领域
build-system
Issue 类型
缺陷
难度
3/5
预计耗时
1-2 天
活跃度
停滞
描述清晰度
基本清楚
新手友好度
38/100

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。