AbsaOSS / AbsaOSS/cobrix

Add an error column containing decoding errors of each record

Abierto
#285 0 comentarios 0 reacciones 0 asignados Ver en GitHub
enhancement
Lenguaje dominante
Scala
Estrellas
170
Forks
96
Merge medio
57 min
PR fusionados (30 d)
2

Descripción

## Background
Spark data sources, like `csv`, create a column containing bogus records it was unable to parse.
Currently, `spark-cobol` just ignores all decoding errors and writes `null` to the target fields.

## Feature
It would be great if `spark-cobol` generated a column `decoring_errors`, containing all fields and values it failed to decode.
This should be optional (with the default being `false`) since generating this column can have an impact on performance and the output size.

Guía de contribución

No hay ninguna guía de contribución indexada para este repositorio

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.