apache / apache/auron

Incorrect filter pushdown in ORC when string stats truncated

Open
#2,042 2 comments 0 reactions 0 assignees View on GitHub
correctness ORC
Dominant language
Rust
Stars
1.8k
Forks
241
Avg merge
2d 14h
Merged PRs (30d)
22

Description

**Describe the bug**
When string statistics are truncated (long strings), the predicate evaluation in row group filtering was incorrect.
https://github.com/datafusion-contrib/orc-rust/pull/79

Additional context
Perhaps we should temporarily disable ORC predicate pushdown?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.