AbsaOSS / AbsaOSS/dataset-comparison
Add switch to fail on duplicate rows
未关闭
enhancement
low
- 主要语言
- Scala
- 星标
- 2
- 派生
- 0
- PR 合并指标
- 30 天内没有已合并 PR
描述
# Description
Some datasets are with duplicate rows, in some it is a major issues, mainly if they do the a (Composite) Primary Key defined. In those cases users would opt to fail fast if duplicates are found.
# Feature
Add a switch to input params to fail if input `A` or `B` has duplicate rows.
> Original author @Zejnilovic
贡献指南
评估
这个 Issue 还没有评估数据。