apache / apache/parquet-java

parquet depends on hadoop-lzo, which requires Twitter's Maven repo

Open
#1,977 0 comments 1 reaction 0 assignees View on GitHub
Component: Parquet Priority: Major Type: enhancement
Dominant language
Java
Stars
3.1k
Forks
1.6k
Avg merge
3d 12h
Merged PRs (30d)
33

Description

I'm trying to add Parquet to my project:

```Java
libraryDependencies += "org.apache.parquet" % "parquet" % "1.8.1"
libraryDependencies += "org.apache.parquet" % "parquet-protobuf" % "1.8.1"
```

But the project appears to depend on hadoop-lzo, which requires adding Twitter's Maven repo as a resolver:
```Java
resolvers += "twitter-repo" at "http://maven.twttr.com"
```

(now sbt resolves and fetches all dependencies)

```Java
# uname -a
Linux pw-246 3.13.0-85-generic #129-Ubuntu SMP Thu Mar 17 20:50:15 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux
# lsb_release -a
No LSB modules are available.
Distributor ID: Ubuntu
Description: Ubuntu 14.04.4 LTS
Release: 14.04
Codename: trusty
# sbt sbtVersion
[info] Loading project definition from xxxxx
[info] Set current project to xxxx (in build file:xxxx)
[info] 0.13.11
```

I suggest that Apache host hadoop-lzo along with the main Parquet dependencies.

**Reporter**: [Paul Wais](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=pwais)

**Note**: *This issue was originally created as [PARQUET-652](https://issues.apache.org/jira/browse/PARQUET-652). Please see the [migration documentation](https://issues.apache.org/jira/browse/PARQUET-2502) for further details.*

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.