apache / apache/arrow

[C++] LevelDecoder::Decode,internal::FindMinMax consume lots of cpu

Open
#50,548 20 comments 0 reactions 1 assignee Claimed by @parthpathak1201 View on GitHub
Component: C++ Type: bug
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

### Describe the bug, including details regarding any error messages, version, and platform.

[problem]
for a page with 6w int,when call record_reader->SkipRecords(59000);
it consume about 1.1ms

[why]
1) for a batch(1024), call FindMinMax, will compute 2048 times(1024 min, 1024 max)
2) 59000/1024=57 rounds

### Component(s)

C++

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.