NVIDIA / NVIDIA/cudf

[FEA] libcudf read json lines mode support nrows

Open
#16,390 2 comments 0 reactions 0 assignees View on GitHub
cudf-polars cuIO feature request libcudf Python
Dominant language
C++
Stars
9.8k
Forks
1.1k
Avg merge
3d 6m
Merged PRs (30d)
278

Description

Support row-count-restricted reads when reading json in `lines` mode.

polars supports this, so we should at least consider supporting it via libcudf.

**Describe the solution you'd like**

An option to specify the number of rows to read for lines mode.
(we should raise if this parameter is used when lines=False)

**Describe alternatives you've considered**

We can post-filter the read dataframe, but that potentially does much more work than necessary.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.