[parquet] Consider pre-allocate the outer vec in row group decoding
Open
- Dominant language
- Rust
- Stars
- 3.6k
- Forks
- 1.3k
- Avg merge
- 2d 18h
- Merged PRs (30d)
- 169
Description
Can we pre-allocate the outer vec?
_Originally posted by @mbrobbel in https://github.com/apache/arrow-rs/pull/7997#discussion_r2432314088_
Contributor guide
Research direction
Start at the row group decoding entry point and trace where the outer vector is created. Confirm the expected capacity source, then verify with the relevant decoding tests or benchmarks that the outer vector is pre-allocated without changing decoded results.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- data-engineering
- Issue type
- Refactor
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100