NVIDIA / NVIDIA/cudf

[FEA] `csv_reader_options` to read empty strings as blank (i.e. `""`), not `null`.

Open
#12,145 3 comments 0 reactions 0 assignees View on GitHub
0 - Backlog cuIO feature request libcudf Python
Dominant language
C++
Stars
9.8k
Forks
1.1k
Avg merge
3d 6m
Merged PRs (30d)
278

Description

When `cudf::io::read_csv()` encounters two consecutive field delimiters within a row, it deems the corresponding string column value as null. E.g.:
```
a,,c
d,,f
```
Reading the input above via `read_csv()` produces rows `{a,null,c}` and `{d,null,f}`. This is conformant with Spark's CSV reader (and presumably Pandas).

It would be useful if the column value could be optionally interpreted as an empty string (`""`) instead. This would permit support for reading [Hive delimited text](https://github.com/NVIDIA/spark-rapids/issues/7069), where empty strings are empty by default.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.