apache/datafusion

View on GitHub

Apache DataFusion SQL Query Engine

Stars: 9.3k
Forks: 2.4k
Open beginner issues: 0
Indexed issues: 1.8k
Avg merge: 3d 6h
Merged PRs (30d): 363

Dominant language: Rust
License: Apache-2.0
Last GitHub push: Sep 20, 2026
Latest indexed: Sep 14, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue help wanted

Beginner friendly Everything

Open All

1,799 open issues indexed

Never fallback to cartesian product for join estimation when we know the min/max values for columns Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 38/100

apache/datafusion#3813 · 1 comment · Opened Oct 12, 2022
Change tdigest centroids number for better accuracy Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 45/100

apache/datafusion#3806 · Opened Oct 12, 2022
Optimizer adds redundant projections on casts with confusing alias Open

bug optimizer

Difficulty 4/5 3-5 days Newbie friendliness 25/100

apache/datafusion#3786 · 8 comments · Opened Oct 10, 2022
Provide a way to enable source level statistics for tables registered in the CLI Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 35/100

apache/datafusion#3774 · 2 comments · Opened Oct 9, 2022
Add `read_parquet` SQL UDF Open

enhancement sql

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#3773 · 1 comment · 1 reaction · Opened Oct 9, 2022
InList does not yet support nested columns. Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 42/100

apache/datafusion#3766 · Opened Oct 8, 2022
Use simpler schema names for expressions Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 45/100

apache/datafusion#3722 · 1 comment · Opened Oct 5, 2022
Add User Guide section on using object stores such as S3 Open

documentation enhancement

Difficulty 3/5 1-2 days Newbie friendliness 38/100

apache/datafusion#3686 · Opened Oct 3, 2022
Add support to write DataFrames to an object store Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#3668 · 1 comment · Opened Sep 30, 2022
Allow user to provide custom filter in ListingTableUrl Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#3655 · 1 reaction · Opened Sep 29, 2022
Change *ExecutionPlan* from trait to enum similar as *LogicalPlan* Open

enhancement

apache/datafusion#3651 · 3 comments · 3 reactions · 1 assignee · Opened Sep 29, 2022
Add more test case for `type coercion` rule Open

Difficulty 3/5 1-2 days Newbie friendliness 25/100

apache/datafusion#3650 · Opened Sep 29, 2022
manual repartitioning overridden by physical optimizer Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 38/100

apache/datafusion#3629 · 6 comments · Opened Sep 27, 2022
Add support for Range partitioning Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 32/100

apache/datafusion#3628 · Opened Sep 27, 2022
[Question] Does DataFusion has a way to know the logical plan and physical plan is deterministic or not ? Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 15/100

apache/datafusion#3618 · 2 comments · Opened Sep 26, 2022
Run some datafusion tests under MIRI Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 38/100

apache/datafusion#3611 · Opened Sep 25, 2022
Account for memory used in SortKeyCursor by row format (spilling Sort) Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 42/100

apache/datafusion#3609 · Opened Sep 25, 2022
Support dot graph output in explain (analyze) Open

enhancement

apache/datafusion#3606 · 14 comments · 1 assignee · Opened Sep 24, 2022
Add `base_config()` accessor function for `NdJsonExec` Open

enhancement

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

apache/datafusion#3604 · 1 comment · Opened Sep 24, 2022
Configure `cargo fmt` for consistent formatting of imports Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 48/100

apache/datafusion#3591 · Opened Sep 22, 2022
Avoiding spilling in TopK queries by reinserting the to-spill data to memory buffer Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 38/100

apache/datafusion#3579 · 3 comments · Opened Sep 21, 2022
make the header not changed when do optimization Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 25/100

apache/datafusion#3568 · 3 comments · Opened Sep 21, 2022
Clean-up the planner logic for moving join predicates from filters in sql/planner.rs which is moved to optimizer rule reduce_cross_join. Open

Difficulty 4/5 3-5 days Newbie friendliness 30/100

apache/datafusion#3554 · 1 reaction · Opened Sep 20, 2022
handling overflow for the integer types Open

bug enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#3520 · 6 comments · 1 reaction · Opened Sep 16, 2022
Exclude input plan's execution time from `elapsed_compute` statistic Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 35/100

apache/datafusion#3494 · Opened Sep 15, 2022
Do't throw the error when projected columns are not in the table schema Open

Difficulty 3/5 1-2 days Newbie friendliness 42/100

apache/datafusion#3492 · Opened Sep 15, 2022
centralize the type coercion code for InList rule Open

Difficulty 4/5 3-5 days Newbie friendliness 20/100

apache/datafusion#3491 · Opened Sep 15, 2022
[EPIC] change SQL numeric literals from float to decimal Open

enhancement PROPOSAL EPIC

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#3480 · 1 comment · Opened Sep 14, 2022
Enable parquet filter pushdown (`filter_pushdown`) by default Open

Difficulty 3/5 1-2 days Newbie friendliness 30/100

apache/datafusion#3463 · 46 comments · 2 reactions · Opened Sep 13, 2022
Fix inconsistencies in type coercion logic Open

bug optimizer

Difficulty 4/5 3-5 days Newbie friendliness 25/100

apache/datafusion#3419 · 6 comments · Opened Sep 9, 2022
Enhance TaskContext and add task failure root cause Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#3410 · 11 comments · Opened Sep 9, 2022
Fix `csv_query_approx_count` once binary type coercion PR is merged Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#3353 · 2 comments · Opened Sep 3, 2022
Improve consistency of expression names Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 30/100

apache/datafusion#3330 · 1 comment · 2 reactions · Opened Sep 1, 2022
Run tpch q5 with 100G data got error Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 28/100

apache/datafusion#3291 · 2 comments · Opened Aug 30, 2022
Need to add an unique id to MetricsSet or ExecutionPlanMetricsSet Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#3033 · 7 comments · Opened Aug 4, 2022
Add Caller Context to the ObjectStore Trait for tracing and diagnostic Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 30/100

apache/datafusion#3020 · 4 comments · Opened Aug 3, 2022
Add and expose metrics in ObjectStore Trait Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#3019 · 1 comment · 1 reaction · Opened Aug 3, 2022
Wrong metric when using EXPLAIN ANALYZE Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 25/100

apache/datafusion#2999 · 1 comment · Opened Aug 1, 2022
Duplication between `ParquetFormat` and `ParquetReadOptions` is confusing Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#2987 · Opened Jul 30, 2022
Better not to display partitions info for ParquetExec Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 45/100

apache/datafusion#2964 · 4 comments · 1 reaction · Opened Jul 26, 2022
Create integration tests for optimizer crate Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#2911 · Opened Jul 14, 2022
[Question] Optimize multiple reads on same DataFrame Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

apache/datafusion#2845 · 1 comment · Opened Jul 6, 2022
Add interface to determine whether expr is a constant Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#2837 · 3 comments · Opened Jul 5, 2022
Investigate unexpected performance issue when adding a filter to reduce rows going into a join Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#2742 · 2 comments · Opened Jun 17, 2022
Enable tab completion in datafusion-cli Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#2652 · 2 comments · Opened May 30, 2022
Improve test coverage in `datafusion-proto` Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#2650 · 1 comment · Opened May 30, 2022
Add subquery support in `datafusion-proto` Open

enhancement help wanted

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#2640 · 5 comments · Opened May 28, 2022
[Discuss] Move extension point traits out of core? Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#2625 · 1 comment · 2 reactions · Opened May 26, 2022
R package Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#2603 · 2 reactions · Opened May 24, 2022
Introduce ProjectionMask To Allow Nested Projection Pushdown Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#2581 · 18 comments · 3 reactions · Opened May 21, 2022

apache/datafusion

Get new issues in your inbox