apache / apache/parquet-java

Classes fail to load when not packaged with Parquet.

Open
#1,794 2 comments 0 reactions 0 assignees View on GitHub
Component: Parquet Priority: Major Type: bug
Dominant language
Java
Stars
3.1k
Forks
1.6k
Avg merge
3d 12h
Merged PRs (30d)
33

Description

Parquet cannot dynamically load classes from another package. This has already been noticed and addressed here: https://github.com/Parquet/parquet-mr/pull/289

However, the fix didn't address all occurrences of Class.forName. parquet-cascading jobs fail trying to load cascading.scheme.Scheme, even though it is present on the classpath.

This bug shows up in cloudera distributions of parquet since they provide parquet jars on the hadoop classpath.

**Reporter**: [Alex Robbins](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=alexrobbins)

**Note**: *This issue was originally created as [PARQUET-261](https://issues.apache.org/jira/browse/PARQUET-261). Please see the [migration documentation](https://issues.apache.org/jira/browse/PARQUET-2502) for further details.*

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reviewing pull request 289 and locating the remaining Class.forName occurrences related to loading cascading.scheme.Scheme. Reproduce the parquet-cascading failure with Parquet jars on the Hadoop classpath, then verify that classes from another package load successfully when present on the classpath.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
backend
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
38/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.