apache / apache/datafusion

FilterExec should not return Non Statistics when it can not calculate the predicate selectivity

Open
#4,372 8 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Rust
Stars
9.3k
Forks
2.4k
Avg merge
3d 7h
Merged PRs (30d)
344

Description

**Describe the bug**
A clear and concise description of what the bug is.

https://github.com/apache/arrow-datafusion/blob/58b43f5c0b629be49a3efa0e37052ec51d9ba3fe/datafusion/core/src/physical_plan/filter.rs#L173-L193

Should return `input_stats`

**To Reproduce**
Steps to reproduce the behavior:

**Expected behavior**
A clear and concise description of what you expected to happen.

**Additional context**
Add any other context about the problem here.

Contributor guide

Open the contributing guide

Research direction

Start in datafusion/core/src/physical_plan/filter.rs at lines 173-193 and inspect how FilterExec handles predicate selectivity. Verify the behavior when selectivity cannot be calculated, then confirm that the result preserves input statistics as described. The issue does not name a reproduction or test file, so identify the relevant existing statistics tests before making the change.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
databases
Issue type
Bug
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.