AbsaOSS / AbsaOSS/enceladus

Enforce quality of metadata that comes from raw INFO files

Ouverte
#875 0 commentaires 0 réactions 0 personnes assignées Voir sur GitHub
feature priority: undecided request Standardization under discussion
Langage dominant
Scala
Étoiles
33
Forks
16
Métriques de merge des PR
Aucune PR mergée en 30 j

Description

## Background
Currently, Enceladus doesn't validate INFO files. It could be helpful for downstream analysis to validate if specific mandatory fields are present and/or in the correct format.

## Feature
Make Standardization refuse to process the data if the provided INFO file does not pass the validation.

## Example [Optional]
* Add validation of the country code field and make sure it has a valid value.
* Add `frequency` field as part of INFO metadata to track how often data is ingested (clarification needed).
* Report date should have a specific format ('yyyy-MM-dd').

Guide de contribution

Ouvrir le guide de contribution

Évaluation

Cette issue n'a pas encore été évaluée.

Recevez les nouvelles issues par e-mail

Un résumé court des issues GitHub adaptées aux débutants.