[Java] Arrow read write support
- Dominant language
- Java
- Stars
- 3.1k
- Forks
- 1.6k
- Avg merge
- 3d 12h
- Merged PRs (30d)
- 33
Description
Native reader/writer implementation on C++ allow user directly read parquet file into Arrow Buffer and Write to parquet file from arrow buffer. However, these features are not supported on Java.
Supports read/write arrow on Java.
**Reporter**: [Masayuki Takahashi](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=masayuki038) / @masayuki038
#### Externally tracked issue: [https://lists.apache.org/thread.html/8783f4cca0bfa9574f53b81a8331f87f0dd8f5b218a7ef6548f50170@%3Cdev.parquet.apache.org%3E](https://lists.apache.org/thread.html/8783f4cca0bfa9574f53b81a8331f87f0dd8f5b218a7ef6548f50170@%3Cdev.parquet.apache.org%3E)
**Note**: *This issue was originally created as [PARQUET-1479](https://issues.apache.org/jira/browse/PARQUET-1479). Please see the [migration documentation](https://issues.apache.org/jira/browse/PARQUET-2502) for further details.*
Contributor guide
No contributing guide indexed for this repository
Research direction
The issue names Java support and the existing native C++ Arrow reader/writer as the reference point, but no Java files or tests. Start by locating those implementations and the Java Parquet read/write entry points, then determine the required parity and add coverage showing Arrow buffers can be read from and written to Parquet.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp, java
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100