AbsaOSS / AbsaOSS/enceladus

Null definitions on input of Standardization

未關閉
#1,522 0 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
Epic priority: undecided Standardization
主要語言
Scala
星號
33
分支
16
PR 合併指標
30 天內沒有已合併 PR

描述

## Background
`Null` value, an uknown field entry, coming from Src can be sometimes defined by some actual special value. This is not covered by Standardization capabilities yet (except `fixedWidth` input format).

## Goal
Make a definition of `null` value on source possible for Standardization

## Expected Task List
A list of expected issues that will be needed to achieve this Epic
1. Command line `--null-value` for _csv_ format
2. `null_value` metadata for column
3. Command-line option of `--null-value` is not covered by any lineage or other quality assurance mechanism. Perhaps the value should be recorded in _INFO file

貢獻指南

開啟貢獻指南

研究方向

The issue names no files, tests, or entry points; begin by locating the CSV standardization command and column-metadata handling in the Scala project. Completion covers the listed scope: a CSV --null-value option, null_value column metadata, and determining whether the option should be recorded in the INFO file.

由索引模型根據 Issue 內容生成。

評估

技術堆疊
scala
領域
cli, data-engineering
Issue 類型
功能
難度
5/5
預估耗時
一週以上
活躍度
停滯
描述清晰度
需要釐清
新手友好度
25/100

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。