NVIDIA / NVIDIA/cudf

[FEA] Parquet reader: replace skip_rows / num_rows with start_row / end_row

Open
#14,465 0 comments 0 reactions 0 assignees View on GitHub
0 - Backlog cuIO feature request libcudf
Dominant language
C++
Stars
9.8k
Forks
1.1k
Avg merge
3d 6m
Merged PRs (30d)
278

Description

Our external interface to the parquet reader allows the user to specify `skip_rows` / `num_rows` parameters when calling it. Internally, we use the same values. But it is a very unwieldy way to think about things. I think it would be easier to immediately convert those values to `start_row` and `end_row` and use that everywhere. It's a nontrivial amount of work to do this without causing bugs but I think the code would be more natural (in the std::algorithms / iterator sense of the word).

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.