apache / apache/arrow

[C++] Parquet RecordReader Skip performance is bad

Open
#38,707 2 comments 0 reactions 0 assignees View on GitHub
Component: C++ Type: bug
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

### Describe the bug, including details regarding any error messages, version, and platform.

![sK1imZDrYQ](https://github.com/apache/arrow/assets/26629109/2817e9d7-0f19-4b25-9939-5feaa025dd89)
I did a perf and found most cpu time spent on alloc and dealloc memory. The issue looks like relates to here https://github.com/apache/arrow/blob/9e5c5b5274928c92a642657e73e8cf84f17bd7b7/cpp/src/parquet/column_reader.cc#L1494C18-L1494C32

### Component(s)

C++

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.