apache / apache/pinot

Support all logical types for Parquet Reader

Open
#11,846 2 comments 0 reactions 1 assignee Claimed by @snleee View on GitHub
ingestion plugins stale
Dominant language
Java
Stars
6.1k
Forks
1.5k
Avg merge
2d 3h
Merged PRs (30d)
195

Description

https://github.com/apache/pinot/pull/11840 fixed the logical decimal types, but we may still missing other logical types used by parquet.
Need to visit all of the logical types and check the possible primitive type supports.

- [ ] StringLogicalTypeAnnotation
- [ ] MapLogicalTypeAnnotation
- [ ] ListLogicalTypeAnnotation
- [ ] EnumLogicalTypeAnnotation
- [x] DecimalLogicalTypeAnnotation
- [x] INT32
- [x] INT64
- [x] BINARY
- [x] FIXED_LEN_BYTE_ARRAY
- [ ] DateLogicalTypeAnnotation
- [ ] TimeLogicalTypeAnnotation
- [ ] TimestampLogicalTypeAnnotation
- [ ] IntLogicalTypeAnnotation
- [ ] JsonLogicalTypeAnnotation
- [ ] BsonLogicalTypeAnnotation
- [ ] UUIDLogicalTypeAnnotation
- [ ] IntervalLogicalTypeAnnotation
- [ ] MapKeyValueTypeAnnotation

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.