Processing checkpoints and destructive operations on Dataframe
未關閉
- 主要語言
- Scala
- 星號
- 30
- 分支
- 9
- PR 合併指標
- 30 天內沒有已合併 PR
描述
We need to come up with a way to process checkpoints between destructive operations. So if I do filtering of the data and lose some rows, I can flag the next checkpoint as "post-destructive", "deduplication" or something similar.
This will pay off a lot when we implement validation #95 and have the ability to attach the control measures onto data frame instead of spark session.
貢獻指南
這個儲存庫沒有索引到貢獻指南
評估
這個 Issue 還沒有評估資料。