AbsaOSS / AbsaOSS/dataset-comparison
Add switch to fail on duplicate rows
Aperta
enhancement
low
- Lingua principale
- Scala
- Stelle
- 2
- Fork
- 0
- Metriche di merge delle PR
- Nessuna PR unita negli ultimi 30g
Descrizione
# Description
Some datasets are with duplicate rows, in some it is a major issues, mainly if they do the a (Composite) Primary Key defined. In those cases users would opt to fail fast if duplicates are found.
# Feature
Add a switch to input params to fail if input `A` or `B` has duplicate rows.
> Original author @Zejnilovic
Guida per i contributori
Apri la guida per i contributori
Valutazione
Questa issue non è ancora stata valutata.