apache / apache/arrow-rs

Extract parquet columns uncompressed size as a statistic

Open
#6,847 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Rust
Stars
3.6k
Forks
1.3k
Avg merge
2d 14h
Merged PRs (30d)
167

Description

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
Part of apache/datafusion#7548, will allow for more accurate statistics reporting for queries with projections.

**Describe the solution you'd like**

**Describe alternatives you've considered**

**Additional context**

Contributor guide

Open the contributing guide

Research direction

No implementation file, test, or entry point is named. Start by reading the referenced DataFusion issue #7548 and locating the Rust Parquet statistics extraction path; done means exposing each column's uncompressed size for downstream projection statistics.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
data-engineering
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.