AbsaOSS / AbsaOSS/spline

Report: Find lineage gaps for data sources

未关闭
#123 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
feature
主要语言
Scala
星标
667
派生
155
平均合并
3 天 6 小时
30 天内合并 PR
4

描述

Consider storing timestamps of all sources during lineage harvesting. These can be used to verify during linking that lineage parent was resolved correctly because timestamps of file that was written needs to match timestamp of file that we read i.e. we read the file that was result of parent lineage.

This would be used as a cross check to make sure the linking of parent-child lineages is correct. Guarding us against possible writes that were not tracked or failed to arrive.

贡献指南

这个仓库没有索引到贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。