AbsaOSS / AbsaOSS/enceladus

Enforce quality of metadata that comes from raw INFO files

未关闭
#875 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
feature priority: undecided request Standardization under discussion
主要语言
Scala
星标
33
派生
16
PR 合并指标
30 天内没有已合并 PR

描述

## Background
Currently, Enceladus doesn't validate INFO files. It could be helpful for downstream analysis to validate if specific mandatory fields are present and/or in the correct format.

## Feature
Make Standardization refuse to process the data if the provided INFO file does not pass the validation.

## Example [Optional]
* Add validation of the country code field and make sure it has a valid value.
* Add `frequency` field as part of INFO metadata to track how often data is ingested (clarification needed).
* Report date should have a specific format ('yyyy-MM-dd').

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。