Add BloomFilter PhysicalExpr
- Dominant language
- Rust
- Stars
- 9.3k
- Forks
- 2.4k
- Avg merge
- 3d 7h
- Merged PRs (30d)
- 344
Description
### Is your feature request related to a problem or challenge?
Related to #15512
I think this is a first step towards HashJoinExec pushdown. I think we should model that as `col >= hash_table_min AND col <= hash_table_max AND hash_table_bloom(col)`. The simple bounds should help with stats pruning, etc.
I believe we could also use this to accelerate `IN ` and re-use the code for bloom filter pruning in parquet scans (just for code reuse)
Contributor guide
Research direction
Start with related issue #15512 and the existing PhysicalExpr and parquet bloom-filter pruning paths mentioned here. Clarify the intended scope for HashJoinExec pushdown, IN , and code reuse before implementation; done should be a reviewed BloomFilter PhysicalExpr with tests for the agreed integrations.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- databases
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100