apache / apache/druid

modernize parquet logical type conversion

Open
#13,312 0 comments 1 reaction 0 assignees View on GitHub
Area - Batch Ingestion Feature/Change Description Refactoring
Dominant language
Java
Stars
14.1k
Forks
3.8k
Avg merge
2d 58m
Merged PRs (30d)
233

Description

### Description
The [Parquet converter](https://github.com/apache/druid/blob/master/extensions-core/parquet-extensions/src/main/java/org/apache/druid/data/input/parquet/simple/ParquetGroupConverter.java#L57) can be updated to use `LogicalTypeAnnotation` when converting logical types (lists, maps), which was not available when this code was originally written. See https://github.com/apache/druid/pull/13294#discussion_r1011985399 for additional details.

Contributor guide

Open the contributing guide

Research direction

Start with extensions-core/parquet-extensions/src/main/java/org/apache/druid/data/input/parquet/simple/ParquetGroupConverter.java around line 57, then read the linked pull request discussion for the conversion context. Update the logical-type conversion for lists and maps to use LogicalTypeAnnotation, and verify that the converter handles those types with the modern API.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data
Issue type
Refactor
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.