SparkSession conformance rule shouldn't kill whole job if key missing
Ouverte
Conformance
feature
Menas
priority: undecided
under discussion
- Langage dominant
- Scala
- Étoiles
- 33
- Forks
- 16
- Métriques de merge des PR
- Aucune PR mergée en 30 j
Description
## Background
When SparkSession conformance rule is unable to find a key that the user has inputted, it kills the whole spark conformance job. This is unexpected.
error: `Exception in thread "main" java.util.NoSuchElementException: XXX`
## Feature
Instead of kill off the job, populate errCol with an apropriate message of not finding the key and put null in the column.
Guide de contribution
Ouvrir le guide de contribution
Évaluation
Cette issue n'a pas encore été évaluée.