SparkSession conformance rule shouldn't kill whole job if key missing
Offen
Conformance
feature
Menas
priority: undecided
under discussion
- Vorherrschende Sprache
- Scala
- Sterne
- 33
- Forks
- 16
- PR-Merge-Kennzahlen
- Keine gemergten PRs in 30 T.
Beschreibung
## Background
When SparkSession conformance rule is unable to find a key that the user has inputted, it kills the whole spark conformance job. This is unexpected.
error: `Exception in thread "main" java.util.NoSuchElementException: XXX`
## Feature
Instead of kill off the job, populate errCol with an apropriate message of not finding the key and put null in the column.
Beitragsleitfaden
Bewertung
Dieses Issue wurde noch nicht bewertet.