AbsaOSS / AbsaOSS/spline

Report: Find lineage gaps for data sources

未關閉
#123 0 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
feature
主要語言
Scala
星號
667
分支
155
平均合併
3 天 6 小時
30 天內合併 PR
4

描述

Consider storing timestamps of all sources during lineage harvesting. These can be used to verify during linking that lineage parent was resolved correctly because timestamps of file that was written needs to match timestamp of file that we read i.e. we read the file that was result of parent lineage.

This would be used as a cross check to make sure the linking of parent-child lineages is correct. Guarding us against possible writes that were not tracked or failed to arrive.

貢獻指南

這個儲存庫沒有索引到貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。