apache / apache/datafusion

Incorrect statistics read for struct array in parquet

Open
#10,609 3 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Rust
Stars
9.3k
Forks
2.4k
Avg merge
3d 7h
Merged PRs (30d)
344

Description

### Describe the bug

I found this while adding tests https://github.com/apache/datafusion/pull/10608. The statistics of struct array returns nothing

### To Reproduce

See `test_struct` in https://github.com/apache/datafusion/pull/10608

### Expected behavior

Return some values for the statistics

### Additional context

_No response_

Contributor guide

Open the contributing guide

Research direction

Start with the `test_struct` test referenced in pull request 10608 and reproduce the reported behavior for struct arrays in Parquet statistics. Trace the statistics read from that test to the relevant DataFusion code. Done means the test returns statistics values instead of nothing.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
databases
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.