AbsaOSS / AbsaOSS/enceladus

Enforce quality of metadata that comes from raw INFO files

Offen
#875 0 Kommentare 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
feature priority: undecided request Standardization under discussion
Vorherrschende Sprache
Scala
Sterne
33
Forks
16
PR-Merge-Kennzahlen
Keine gemergten PRs in 30 T.

Beschreibung

## Background
Currently, Enceladus doesn't validate INFO files. It could be helpful for downstream analysis to validate if specific mandatory fields are present and/or in the correct format.

## Feature
Make Standardization refuse to process the data if the provided INFO file does not pass the validation.

## Example [Optional]
* Add validation of the country code field and make sure it has a valid value.
* Add `frequency` field as part of INFO metadata to track how often data is ingested (clarification needed).
* Report date should have a specific format ('yyyy-MM-dd').

Beitragsleitfaden

Beitragsleitfaden öffnen

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.