AbsaOSS / AbsaOSS/enceladus

Support enhanced timestamp logical types in standardization schema

Offen
#174 0 Kommentare 0 Reaktionen 1 zugewiesene Person Beansprucht von @benedeki Auf GitHub ansehen
feature Menas priority: low
Vorherrschende Sprache
Scala
Sterne
33
Forks
16
PR-Merge-Kennzahlen
Keine gemergten PRs in 30 T.

Beschreibung

## Background
Currently, the way we infer the timezone is if the schema's metadata provides a timezone in the timestamp pattern or an additional timezone field. If no such information is provided we assume it is already UTC.

## Feature
It would be helpful to users to make the distinction between `timezoned` and `presumed-UTC` timestamps in the UI.
However, it is important to note that we shouldn't enforce this in the actual schema file as that would make the schemas we use and the actual `SparkStruct` schemas would no longer be compatible.

## Proposed Solution
Once a schema editor is implemented (#31) we can incorporate these two logical types to make it easier for users to provide the proper timezone information.

Beitragsleitfaden

Beitragsleitfaden öffnen

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.