AbsaOSS / AbsaOSS/enceladus

Support enhanced timestamp logical types in standardization schema

Abierto
#174 0 comentarios 0 reacciones 1 asignado Reclamado por @benedeki Ver en GitHub
feature Menas priority: low
Lenguaje dominante
Scala
Estrellas
33
Forks
16
Métricas de merge de PR
Sin PR fusionados en 30 d

Descripción

## Background
Currently, the way we infer the timezone is if the schema's metadata provides a timezone in the timestamp pattern or an additional timezone field. If no such information is provided we assume it is already UTC.

## Feature
It would be helpful to users to make the distinction between `timezoned` and `presumed-UTC` timestamps in the UI.
However, it is important to note that we shouldn't enforce this in the actual schema file as that would make the schemas we use and the actual `SparkStruct` schemas would no longer be compatible.

## Proposed Solution
Once a schema editor is implemented (#31) we can incorporate these two logical types to make it easier for users to provide the proper timezone information.

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.