NVIDIA / NVIDIA/cudf

[FEA] JNI `CSVOptions` for skipping blank lines

Open
#12,144 0 comments 0 reactions 1 assignee Claimed by @mythrocks View on GitHub
1 - On Deck feature request Java Spark
Dominant language
C++
Stars
9.8k
Forks
1.1k
Avg merge
3d 6m
Merged PRs (30d)
278

Description

[`cudf::io::csv_reader_options::enable_skip_blank_lines()`](https://github.com/rapidsai/cudf/blob/branch-22.12/cpp/include/cudf/io/csv.hpp#L665) provides a configuration option to choose whether to skip blank lines in an input file. This decides whether a blank line constitutes another input row.

`enable_skip_blank_lines()` does not have a corresponding setter in Java via `ai.rapids.cudf.CSVOptions`. This would be valuable for data-formats like [Hive delimited text](https://github.com/NVIDIA/spark-rapids/pull/7068).

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.