Null definitions on input of Standardization
- Dominant language
- Scala
- Stars
- 33
- Forks
- 16
- PR merge metrics
- No merged PRs in 30d
Description
## Background
`Null` value, an uknown field entry, coming from Src can be sometimes defined by some actual special value. This is not covered by Standardization capabilities yet (except `fixedWidth` input format).
## Goal
Make a definition of `null` value on source possible for Standardization
## Expected Task List
A list of expected issues that will be needed to achieve this Epic
1. Command line `--null-value` for _csv_ format
2. `null_value` metadata for column
3. Command-line option of `--null-value` is not covered by any lineage or other quality assurance mechanism. Perhaps the value should be recorded in _INFO file
Contributor guide
Research direction
The issue names no files, tests, or entry points; begin by locating the CSV standardization command and column-metadata handling in the Scala project. Completion covers the listed scope: a CSV --null-value option, null_value column metadata, and determining whether the option should be recorded in the INFO file.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- scala
- Domain
- cli, data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100