apache / apache/arrow-rs

[Parquet] Add ALP regression coverage for an empty first page

Closed
#10,644 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
3.6k
Forks
1.3k
Avg merge
2d 18h
Merged PRs (30d)
169

Description

### Describe the bug

Add regression coverage for encoding a column chunk whose first data page is empty or contains only nulls, followed by a page containing values.

See [@alamb's comment](https://github.com/apache/arrow-rs/pull/9372#issuecomment-5217749936) and [@devanbenz's suggested regression test](https://github.com/apache/arrow-rs/pull/9372#discussion_r3737514569).

This depends on #9372 and should be worked on after that PR is merged.

Contributor guide

Open the contributing guide

Research direction

Start by reading PR #9372 and the linked comment and suggested regression-test discussion. Add coverage for a column chunk whose first data page is empty or contains only nulls, followed by a page with values, after #9372 is merged; the regression test should pass for this sequence.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
data-engineering
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.