NVIDIA / NVIDIA/cudf

[BUG] For certain parquet list schemas, the root PageNestingInfo struct can end up uninitialized.

Open
#14,634 0 comments 0 reactions 0 assignees View on GitHub
bug cuIO Python
Dominant language
C++
Stars
9.8k
Forks
1.1k
Avg merge
3d 6m
Merged PRs (30d)
278

Description

Inside of the `allocate_nesting_info` function, we allocate PageNestingInfo and PageNestingDecodeInfo structs and initialize them. However, the logic for traversing the schema in the file can sometimes leave the 0th element uninitialized. This is a mild bug that leads to a slightly wrong size calculating for output chunk sizes in the chunked reader.

The easiest way to repro is with the file `python/cudf/cudf/tests/data/parquet/one_level_list.parquet`

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.