AbsaOSS / AbsaOSS/enceladus

SparkSession conformance rule shouldn't kill whole job if key missing

未关闭
#543 2 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
Conformance feature Menas priority: undecided under discussion
主要语言
Scala
星标
33
派生
16
PR 合并指标
30 天内没有已合并 PR

描述

## Background
When SparkSession conformance rule is unable to find a key that the user has inputted, it kills the whole spark conformance job. This is unexpected.

error: `Exception in thread "main" java.util.NoSuchElementException: XXX`

## Feature
Instead of kill off the job, populate errCol with an apropriate message of not finding the key and put null in the column.

贡献指南

打开贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。