apache / apache/parquet-java

Make ParquetReader(List<InputFile>, ParquetReadOptions, ReadSupport<T>) constructor public

Open
#2,401 0 comments 0 reactions 0 assignees View on GitHub
Component: Java Component: Parquet Priority: Major Type: enhancement
Dominant language
Java
Stars
3.1k
Forks
1.6k
Avg merge
3d 12h
Merged PRs (30d)
33

Description

My application uses s3 storage to store parquet files. The problem is that there is not ability to get rid from `new Configuration(true);` which load configuration from files:
`core-default.xml` and `core-site.xml` every time when ParquetReader instance is created.

I suggest just make ParquetReader(List, ParquetReadOptions, ReadSupport) constructor public then there will be ability to do custom builder.

**Reporter**: [Dmitry Sysolyatin](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=dmsysolyatin)
#### PRs and other links:
- [GitHub Pull Request #707](https://github.com/apache/parquet-mr/pull/707)

**Note**: *This issue was originally created as [PARQUET-1719](https://issues.apache.org/jira/browse/PARQUET-1719). Please see the [migration documentation](https://issues.apache.org/jira/browse/PARQUET-2502) for further details.*

Contributor guide

No contributing guide indexed for this repository

Research direction

Start at the ParquetReader(List, ParquetReadOptions, ReadSupport) constructor and inspect how the existing builder creates readers. Make the constructor publicly accessible so callers can create a custom builder without the unwanted Configuration loading, then verify the existing reader behavior remains intact.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data
Issue type
Feature
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.