apache / apache/auron

Incorrect Not predicate evaluation in ORC filtering pushdown

Open
#2,005 1 comment 0 reactions 0 assignees View on GitHub
correctness ORC
Dominant language
Rust
Stars
1.8k
Forks
241
Avg merge
2d 14h
Merged PRs (30d)
22

Description

**Describe the bug**
The `Not` predicate evaluation in row group filtering was incorrect.
https://github.com/datafusion-contrib/orc-rust/pull/78

**To Reproduce**
```scala
test("test string type filter for orc table") {
withTable("orc_string_filter") {
sql("create table orc_string_filter(id int, b string) using orc")
sql("insert into orc_string_filter values (1, 'abc'), (2, null), (3, 'def')")
checkSparkAnswerAndOperator("select * from orc_string_filter where b is not null")
}
}
```
**Additional context**
Perhaps we should temporarily disable ORC predicate pushdown.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.