apache / apache/parquet-java

parquet depends on hadoop-lzo, which requires Twitter's Maven repo

未关闭
#1,977 0 条评论 1 个 reaction 已指派 0 人 在 GitHub 查看
Component: Parquet Priority: Major Type: enhancement
主要语言
Java
星标
3.1k
派生
1.6k
平均合并
3 天 12 小时
30 天内合并 PR
33

描述

I'm trying to add Parquet to my project:

```Java
libraryDependencies += "org.apache.parquet" % "parquet" % "1.8.1"
libraryDependencies += "org.apache.parquet" % "parquet-protobuf" % "1.8.1"
```

But the project appears to depend on hadoop-lzo, which requires adding Twitter's Maven repo as a resolver:
```Java
resolvers += "twitter-repo" at "http://maven.twttr.com"
```

(now sbt resolves and fetches all dependencies)

```Java
# uname -a
Linux pw-246 3.13.0-85-generic #129-Ubuntu SMP Thu Mar 17 20:50:15 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
# lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 14.04.4 LTS
Release: 14.04
Codename: trusty
# sbt sbtVersion
[info] Loading project definition from xxxxx
[info] Set current project to xxxx (in build file:xxxx)
[info] 0.13.11
```

I suggest that Apache host hadoop-lzo along with the main Parquet dependencies.

**Reporter**: [Paul Wais](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=pwais)

**Note**: *This issue was originally created as [PARQUET-652](https://issues.apache.org/jira/browse/PARQUET-652). Please see the [migration documentation](https://issues.apache.org/jira/browse/PARQUET-2502) for further details.*

贡献指南

这个仓库没有索引到贡献指南

调研方向

从已发布的依赖关系图开始,检查 Parquet 的依赖声明以及 issue 中描述的 hadoop-lzo 解析路径。确认 hadoop-lzo 从何处获取,以及它是否可以与主要的 Parquet 依赖一起托管;当使用者无需添加 Twitter 的 Maven 仓库即可解析 Parquet 时,即表示完成。

由索引模型根据 Issue 内容生成。

评估

技术栈
java
领域
build-system
Issue 类型
缺陷
难度
4/5
预计耗时
3-5 天
活跃度
停滞
描述清晰度
需要澄清
新手友好度
35/100

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。