AbsaOSS / AbsaOSS/enceladus

Null definitions on input of Standardization

Offen
#1,522 0 Kommentare 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
Epic priority: undecided Standardization
Vorherrschende Sprache
Scala
Sterne
33
Forks
16
PR-Merge-Kennzahlen
Keine gemergten PRs in 30 T.

Beschreibung

## Background
`Null` value, an uknown field entry, coming from Src can be sometimes defined by some actual special value. This is not covered by Standardization capabilities yet (except `fixedWidth` input format).

## Goal
Make a definition of `null` value on source possible for Standardization

## Expected Task List
A list of expected issues that will be needed to achieve this Epic
1. Command line `--null-value` for _csv_ format
2. `null_value` metadata for column
3. Command-line option of `--null-value` is not covered by any lineage or other quality assurance mechanism. Perhaps the value should be recorded in _INFO file

Beitragsleitfaden

Beitragsleitfaden öffnen

Rechercherichtung

The issue names no files, tests, or entry points; begin by locating the CSV standardization command and column-metadata handling in the Scala project. Completion covers the listed scope: a CSV --null-value option, null_value column metadata, and determining whether the option should be recorded in the INFO file.

Vom Indexierungsmodell aus dem Issue-Text verfasst.

Bewertung

Tech-Stack
scala
Bereich
cli, data-engineering
Issue-Typ
Feature
Schwierigkeit
5/5
Geschätzter Aufwand
Über eine Woche
Aktivitätsstatus
Veraltet
Klarheit
Muss geklärt werden
Anfängerfreundlichkeit
25/100

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.