AbsaOSS / AbsaOSS/enceladus

Add _INFO file validation

Aperta
#1,186 0 commenti 0 reazioni 1 assegnatario Rivendicata da @AdrianOlosutean Vedi su GitHub
3rd party issue feature priority: medium Standardization under discussion
Lingua principale
Scala
Stelle
33
Fork
16
Metriche di merge delle PR
Nessuna PR unita negli ultimi 30g

Descrizione

## Background
Currently, most fields of an _INFO file are not validated.

## Feature
Add _INFO file validation for Enceladus when Atum starts to support custom validators of _INFO files ([Atum/#22](https://github.com/AbsaOSS/atum/issues/22) and [Atum/#23](https://github.com/AbsaOSS/atum/issues/23))

## Here is the list of validations (to be extended)
- [x] Make sure 'Source' and 'Raw' checkpoints are present when Standardization starts.
- [ ] Country field should conform to the standardized list of countries (a MDR table).
- [ ] Source system name should be from the list of source system names (a MDR table).
- [ ] The information date should be in 'YYYY-MM-DD' format. Validate the date is the same as the report date
- [ ] Processing Start/Finish should be in a consistent format across checkpoints. Need to add validation of checkpoints created prior to Standardization.

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.