AbsaOSS / AbsaOSS/enceladus

Add support for CSV comments

Open
#1,325 0 comments 0 reactions 0 assignees View on GitHub
feature priority: low Standardization
Dominant language
Scala
Stars
33
Forks
16
PR merge metrics
No merged PRs in 30d

Description

## Background
CSV supports comments. Each line that begins with a comment character ('#' by default) is skipped.

## Feature
Add a command-line option to specify comment character. An empty string can also be specified, either as `''` or as per #1319 .

## Example [Optional]
```
spark-submit ... --csv-comment #
```

## Proposed Solution [Optional]
Use `.option("comment", char)` to specify the comment character (default="#"). If it is `null`, comments are disabled.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.