AbsaOSS / AbsaOSS/enceladus

Null definitions on input of Standardization

Abierto
#1,522 0 comentarios 0 reacciones 0 asignados Ver en GitHub
Epic priority: undecided Standardization
Lenguaje dominante
Scala
Estrellas
33
Forks
16
Métricas de merge de PR
Sin PR fusionados en 30 d

Descripción

## Background
`Null` value, an uknown field entry, coming from Src can be sometimes defined by some actual special value. This is not covered by Standardization capabilities yet (except `fixedWidth` input format).

## Goal
Make a definition of `null` value on source possible for Standardization

## Expected Task List
A list of expected issues that will be needed to achieve this Epic
1. Command line `--null-value` for _csv_ format
2. `null_value` metadata for column
3. Command-line option of `--null-value` is not covered by any lineage or other quality assurance mechanism. Perhaps the value should be recorded in _INFO file

Guía de contribución

Abrir la guía de contribución

Línea de trabajo

The issue names no files, tests, or entry points; begin by locating the CSV standardization command and column-metadata handling in the Scala project. Completion covers the listed scope: a CSV --null-value option, null_value column metadata, and determining whether the option should be recorded in the INFO file.

Escrito por el modelo de indexación a partir del texto del issue.

Evaluación

Stack tecnológico
scala
Área
cli, data-engineering
Tipo de issue
Nueva funcionalidad
Dificultad
5/5
Tiempo estimado
Más de una semana
Estado de actividad
Estancado
Claridad
Necesita aclaración
Aptitud para principiantes
25/100

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.