[Vectorized Reader] Support Complex Types (Map, Array, Struct) in Parquet Vectorized Reader
- Dominant language
- Java
- Stars
- 3.1k
- Forks
- 1.6k
- Avg merge
- 3d 12h
- Merged PRs (30d)
- 33
Description
https://github.com/zhenxiao/incubator-parquet-mr/tree/vector
Has support for primitive types. Needs to support complex types as well
**Reporter**: [Zhenxiao Luo](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=zhenxiao) / @zhenxiao
**Assignee**: [Nezih Yigitbasi](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=nezihyigitbasi) / @nezihyigitbasi
#### PRs and other links:
- [PR-257](https://github.com/apache/parquet-mr/pull/257)
**Note**: *This issue was originally created as [PARQUET-298](https://issues.apache.org/jira/browse/PARQUET-298). Please see the [migration documentation](https://issues.apache.org/jira/browse/PARQUET-2502) for further details.*
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the vector branch linked in the issue and review the existing primitive-type support. Check PR-257 and the related Parquet vectorized reader changes before determining the remaining work. Done means Map, Array, and Struct types are supported alongside primitive types.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 20/100