AbsaOSS / AbsaOSS/cobrix

Add an error column containing decoding errors of each record

未关闭
#285 0 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
enhancement
主要语言
Scala
星标
170
派生
96
平均合并
57 分钟
30 天内合并 PR
2

描述

## Background
Spark data sources, like `csv`, create a column containing bogus records it was unable to parse.
Currently, `spark-cobol` just ignores all decoding errors and writes `null` to the target fields.

## Feature
It would be great if `spark-cobol` generated a column `decoring_errors`, containing all fields and values it failed to decode.
This should be optional (with the default being `false`) since generating this column can have an impact on performance and the output size.

贡献指南

这个仓库没有索引到贡献指南

评估

这个 Issue 还没有评估数据。

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。