apache / apache/datafusion

Optimize FilterExec when output projection is empty

Open
#19,972 5 comments 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
9.3k
Forks
2.4k
Avg merge
3d 7h
Merged PRs (30d)
344

Description

consider `select count(*) from t where id > 5`. I think we still build a mask, etc. internally but in the case we have no output projection we could maybe track just the number of matching rows as an integer? maybe there's already something in place, just jotting down thoughts.

Contributor guide

Open the contributing guide

Research direction

Begin at FilterExec and reproduce the example query, `select count(*) from t where id > 5`. Inspect whether an empty output projection still builds a mask or other projection state; the issue names no files or tests, so completion criteria must include validating the count-only execution path and its performance.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust, sql
Domain
backend, data-engineering, performance
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
32/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.