apache / apache/parquet-java

Support extended precision for nanosecond timestamps

Open
#3,679 0 comments 0 reactions 0 assignees View on GitHub
Type: enhancement
Dominant language
Java
Stars
3.1k
Forks
1.6k
Avg merge
3d 12h
Merged PRs (30d)
33

Description

### Describe the enhancement requested

Implement the proposal in https://github.com/apache/parquet-format/issues/600 and the linked [proposal document](https://docs.google.com/document/d/1H43RQZhWKcg9c4tJO5W87YxhbUxN7qGSFxJBrrwWOfY/edit?tab=t.0#heading=h.ccmrsmcbig6b) to allow the `TimestampType` logical type to annotate `FIXED_LEN_BYTE_ARRAY` physical type with `type_length = 12`.

### Component(s)

Core

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reading parquet-format issue 600 and the linked proposal document to understand the extended-precision timestamp representation. Then inspect the Java implementation of TimestampType and related core tests; done means TimestampType can annotate FIXED_LEN_BYTE_ARRAY with type_length = 12, with coverage for the new behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.