apache / apache/parquet-format
add logical type timestamp with timezone (per SQL)
- Dominant language
- Thrift
- Stars
- 2.6k
- Forks
- 508
- Avg merge
- 2d 8h
- Merged PRs (30d)
- 4
Description
timestamp with timezone (per SQL)
timestamps are adjusted to UTC and stored as integers.
metadata in logical types PR:
See discussion here: https://github.com/apache/parquet-format/pull/51#discussion_r109667837
**Reporter**: [Julien Le Dem](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=julienledem) / @julienledem
**Assignee**: [Julien Le Dem](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=julienledem) / @julienledem
#### Related issues:
- [Release Parquet format 2.4.0](https://github.com/apache/parquet-format/issues/274) (depends upon)
- [Update parquet.thrift from https://github.com/apache/parquet-format](https://github.com/apache/arrow/issues/42523) (is depended upon by)
#### PRs and other links:
- [PR #51: Add new LogicalType structures to the format](https://github.com/apache/parquet-format/pull/51)
**Note**: *This issue was originally created as [PARQUET-906](https://issues.apache.org/jira/browse/PARQUET-906). Please see the [migration documentation](https://issues.apache.org/jira/browse/PARQUET-2502) for further details.*
Contributor guide
Research direction
Start by reading the logical types discussion in PR #51 and the linked SQL timestamp semantics. Check how the format metadata represents timestamps adjusted to UTC and stored as integers; done means the new timestamp-with-timezone logical type is defined consistently with that behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- sql
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 25/100