apache/datafusion

View on GitHub

Apache DataFusion SQL Query Engine

Stars: 9.3k
Forks: 2.4k
Open beginner issues: 0
Indexed issues: 1.8k
Avg merge: 3d 6h
Merged PRs (30d): 363

Dominant language: Rust
License: Apache-2.0
Last GitHub push: Sep 20, 2026
Latest indexed: Sep 14, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue help wanted

Beginner friendly Everything

Open All

1,799 open issues indexed

Deduplicate equijoin predicate in optimizer Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#4732 · Opened Dec 26, 2022
Default generated column name is confusing on casts Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#4723 · 1 comment · 1 reaction · Opened Dec 23, 2022
Support Apache ORC File Format, and Use Sparse Index Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#4707 · 12 comments · Opened Dec 22, 2022
Normalize the order of binary expression Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#4688 · 1 comment · 1 reaction · Opened Dec 21, 2022
Support using named tuples in IN clause Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#4656 · Opened Dec 16, 2022
Support ExistenceJoin type in HashJoin Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 25/100

apache/datafusion#4655 · 1 reaction · Opened Dec 16, 2022
Sort options for DataType::Dictionary is incorrect Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 42/100

apache/datafusion#4649 · 1 comment · Opened Dec 15, 2022
Add session config to specify default sort key options(Nulls First or Nulls Last) Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

apache/datafusion#4647 · 1 comment · Opened Dec 15, 2022
Support Const Propagation for Variables Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#4630 · Opened Dec 14, 2022
Make ExecutionProps a Trait Open

enhancement

apache/datafusion#4629 · 1 assignee · Opened Dec 14, 2022
Remove Arc<LogicalPlan> from LogicalPlan, stop copying LogicalPlans Open

enhancement

apache/datafusion#4628 · 19 comments · 4 reactions · 1 assignee · Opened Dec 14, 2022
Make OptimizerRule Consuming Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#4627 · 2 comments · 2 reactions · Opened Dec 14, 2022
Extend DiskManager to manager other temp files like temp shuffle IPC files in Ballista, cached data files etc Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

apache/datafusion#4564 · 7 comments · Opened Dec 9, 2022
DataTypes support hash Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 30/100

apache/datafusion#4537 · Opened Dec 7, 2022
Failed to project when items contain expr and Cast(expr) Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 25/100

apache/datafusion#4478 · 4 comments · Opened Dec 2, 2022
Follwup #4425 Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

apache/datafusion#4433 · Opened Nov 30, 2022
enhance rule for more join type. Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#4413 · Opened Nov 29, 2022
Support `abs` func in PruningPredicate for static pruning Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

apache/datafusion#4388 · 2 comments · Opened Nov 27, 2022
FilterExec should not return Non Statistics when it can not calculate the predicate selectivity Open

bug

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

apache/datafusion#4372 · 8 comments · Opened Nov 25, 2022
Avoid unnecessary RepartitionExec with RoundRobinBatch partitioning Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#4368 · Opened Nov 25, 2022
Implement protobuf serialization for Expr::ScalarSubquery(_) | Expr::InSubquery { .. } | Expr::Exists { .. } Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#4337 · 1 comment · Opened Nov 23, 2022
Hashed Aggregator panics when aggregate fn returns an error Open

bug

Difficulty 3/5 1-2 days Newbie friendliness 42/100

apache/datafusion#4315 · Opened Nov 22, 2022
Change representation of partition in FileScanConfig Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#4295 · 3 comments · Opened Nov 20, 2022
Null-Aware Anti Join Support Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#4211 · 7 comments · Opened Nov 15, 2022
Improve schema merging Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#4223 · 2 comments · Opened Nov 15, 2022
Cannot register table to represent multiple parquet files in S3 bucket Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 30/100

apache/datafusion#4204 · 3 comments · Opened Nov 14, 2022
It will be good to have Bucketizer and OneHotEncoder in DataFusion like PySpark Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#4195 · Opened Nov 13, 2022
Continue to break datafusion crate into smaller crates Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#4181 · 2 comments · 2 reactions · Opened Nov 11, 2022
Use arrow row format in GroupByHash rather than datafusion row format Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#4179 · 3 comments · 2 reactions · Opened Nov 11, 2022
Automatically detect and use "is the data sorted" information in parquet file metadata Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 28/100

apache/datafusion#4177 · 5 comments · Opened Nov 11, 2022
Support for Time and Date types Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#4171 · 2 comments · Opened Nov 10, 2022
The functions in `type_coercion` should return `Result`, not `Option` Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#4165 · Opened Nov 10, 2022
Determine the expression boundaries of an OR conjuction Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#4159 · 1 reaction · Opened Nov 9, 2022
Determine the expression boundaries of an `AND` conjuction Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#4158 · Opened Nov 9, 2022
Support CartesianProduct partition model in CrossJoinExec Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 15/100

apache/datafusion#4117 · Opened Nov 6, 2022
Support RangePartition and OrderedDistribution Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 10/100

apache/datafusion#4116 · Opened Nov 6, 2022
Use roaring bitmap in hash join for tracking hash collisions Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

apache/datafusion#4093 · 2 comments · Opened Nov 3, 2022
Improve speed of benchmark verification tests Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#4032 · Opened Oct 30, 2022
ScalarUDF called twice when using filter on UDF column Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#4030 · 1 comment · Opened Oct 30, 2022
Representing statistics in logical or physical plans (or in both of them) Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#4003 · 5 comments · Opened Oct 28, 2022
Record per-predicate statistics for effectiveness of parquet predicate pushdown Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#3998 · Opened Oct 28, 2022
change `extract` return types to decimal to align with postgres Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 42/100

apache/datafusion#3996 · 3 comments · Opened Oct 28, 2022
[DISCUSSION] Naming convention for non-aliased columns Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#3990 · 8 comments · Opened Oct 27, 2022
Implement TableProvider.statistics for Parquet TableProvider Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#3988 · Opened Oct 27, 2022
Change back to non async interface for try_into_logical_plan Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

apache/datafusion#3954 · 1 comment · Opened Oct 25, 2022
[EPIC] Improving cost calculations and cost based optimizations Open

enhancement PROPOSAL EPIC

Difficulty 5/5 Over a week Newbie friendliness 20/100

apache/datafusion#3929 · 8 comments · 3 reactions · Opened Oct 22, 2022
Consolidate SessionConfig and ConfigOptions Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 28/100

apache/datafusion#3887 · 3 comments · 2 reactions · Opened Oct 18, 2022
regression in optimizing filter push down of CAST + BETWEEN Open

bug optimizer

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#3863 · 1 comment · Opened Oct 17, 2022
Implement nested join optimization Open

enhancement optimizer performance

apache/datafusion#3843 · 15 comments · 3 reactions · 1 assignee · Opened Oct 15, 2022
Move WHERE expression to join conversion to optimization rule Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#3840 · 1 comment · Opened Oct 15, 2022

apache/datafusion

Get new issues in your inbox