apache/datafusion

View on GitHub

Apache DataFusion SQL Query Engine

Stars: 9.3k
Forks: 2.4k
Open beginner issues: 0
Indexed issues: 1.8k
Avg merge: 3d 7h
Merged PRs (30d): 358

Dominant language: Rust
License: Apache-2.0
Last GitHub push: Sep 20, 2026
Latest indexed: Sep 14, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue help wanted

Beginner friendly Everything

Open All

1,799 open issues indexed

Use Matomo in https://arrow.apache.org/datafusion/ Open

enhancement

Difficulty 2/5 1-3 hours Newbie friendliness 30/100

apache/datafusion#2532 · Opened May 13, 2022
Any plan to implement datafusion go/c++ binding? Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 30/100

apache/datafusion#2485 · 10 comments · 14 reactions · Opened May 8, 2022
Improve expressions to completely support `NULL` constants Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#2483 · 2 reactions · Opened May 7, 2022
`FilterPushdown` should be aware of and ignore correlated predicates Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 32/100

apache/datafusion#2459 · Opened May 5, 2022
Support complete `distinct` usage for aggregate expressions Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 45/100

apache/datafusion#2406 · 4 comments · Opened May 2, 2022
Add a built-in UDAF approx_sum_topn based on space saving algorithm Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 30/100

apache/datafusion#2365 · Opened Apr 28, 2022
Move Accumulator trait to physical-expr Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#2349 · 2 comments · 2 reactions · Opened Apr 27, 2022
Support Multi-Column Producing Function Implementation Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#2343 · 2 comments · Opened Apr 26, 2022
Consolidate MergeJoin with HashJoin to adaptive join relations according to runtime resources and table sizes Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

apache/datafusion#2316 · 1 reaction · Opened Apr 22, 2022
Rename SortMergeJoinExec and SortMergeJoinStream to MergeJoin and MergeJoinStream Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

apache/datafusion#2315 · Opened Apr 22, 2022
Project Hive Partition Columns With ProjectionExec Open

enhancement help wanted

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#2291 · 1 reaction · Opened Apr 20, 2022
[datafusion-contrib] Support Stand Alone Hive MetaStore Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 30/100

apache/datafusion#2209 · 5 reactions · Opened Apr 12, 2022
Support SymlinkTextInputFormat FileFormat Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#2208 · 2 reactions · Opened Apr 12, 2022
[datafusion-contrib] AWS Glue Integration Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#2206 · 2 comments · 4 reactions · Opened Apr 12, 2022
[Discuss] Different implementation style between Expr, LogicalPlan and ExecutionPlan Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

apache/datafusion#2175 · 32 comments · Opened Apr 7, 2022
Maybe we should eventually move the `parquet_pruning` option out of `SessionContext` and into the `ParquetReadOptions` structure. As a follow on PR Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

apache/datafusion#2138 · Opened Apr 2, 2022
No suitable object store found for *** Open

bug

Difficulty 3/5 1-2 days Newbie friendliness 45/100

apache/datafusion#2136 · 7 comments · Opened Apr 2, 2022
Introduce the object stores in datafusion-contrib as optional features in the datafusion core Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#2072 · 1 comment · Opened Mar 24, 2022
Build physical filter eagerly while constructing ParquetExec operator Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 42/100

apache/datafusion#2059 · 4 comments · Opened Mar 22, 2022
Add high water mark to MemoryManager Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 30/100

apache/datafusion#2053 · 1 comment · 2 reactions · Opened Mar 22, 2022
beautify default column names Open

enhancement good first issue

Difficulty 3/5 1-2 days Newbie friendliness 35/100

apache/datafusion#2027 · 13 comments · 2 reactions · Opened Mar 17, 2022
The return type of EXTRACT Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

apache/datafusion#1992 · 9 comments · Opened Mar 11, 2022
DataFusion Optimizer framework discussion Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

apache/datafusion#1972 · 27 comments · Opened Mar 10, 2022
More efficient Dictionary / constant encoding for partition values in ListingFileProvider Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 30/100

apache/datafusion#1931 · 2 comments · Opened Mar 5, 2022
Postgres `ARRAY_AGG(JSON_BUILD_OBJECT())` equivalent? Possible with `struct` SQL operator? Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#1897 · Opened Feb 28, 2022
implement bitmap_distinct function using bitmap Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#1823 · 6 comments · Opened Feb 14, 2022
Eliminate Unsatisfiable Boolean Expressions Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#1716 · 10 comments · Opened Jan 31, 2022
Support predicate pruning on `Expr::Case` expressions Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#1692 · 1 comment · Opened Jan 28, 2022
Testing result of String related built-in functions Open

bug

Difficulty 5/5 Over a week Newbie friendliness 20/100

apache/datafusion#1688 · 6 comments · 2 reactions · Opened Jan 27, 2022
Set-returning UDFs Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#1604 · 4 comments · Opened Jan 18, 2022
decimal support for agg function Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 55/100

apache/datafusion#1545 · 8 comments · Opened Jan 11, 2022
Renaming Tests Discussion Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#1505 · 8 comments · Opened Dec 29, 2021
Is it able to decouple tokio, allow to use custom async executor? Open

enhancement help wanted

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#1478 · 4 comments · Opened Dec 23, 2021
Use dynamic arrow compute kernels Open

enhancement

apache/datafusion#1474 · 1 assignee · Opened Dec 22, 2021
Remove `Alias` from `Expr` Open

api change enhancement

Difficulty 5/5 Over a week Newbie friendliness 42/100

apache/datafusion#1468 · 23 comments · 6 reactions · Opened Dec 20, 2021
Add document for explaining the promotion precision and scale for decimal data type Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 25/100

apache/datafusion#1461 · Opened Dec 17, 2021
use a different prefix than `@` to represent variables Open

bug

Difficulty 3/5 1-2 days Newbie friendliness 35/100

apache/datafusion#1436 · Opened Dec 11, 2021
Caching datasets in context [Question] Open

question

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#1396 · 10 comments · Opened Dec 3, 2021
should in memory table have TableType::Temporary type? Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#1270 · 1 comment · Opened Nov 8, 2021
Implement statistics estimation for partition columns Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 45/100

apache/datafusion#1186 · 2 comments · Opened Oct 28, 2021
Use specialized dictionary compute kernels for binary PhysicalExpr evaluation Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#1178 · Opened Oct 26, 2021
Update data in SQL tests to have necessary precision for tests Open

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

apache/datafusion#1151 · 1 reaction · Opened Oct 20, 2021
`approx_distinct` should be leveraging dictionary encoding to support faster counting for these types Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#1115 · 1 comment · Opened Oct 14, 2021
persistence for `ExecutionContextState`? Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#755 · 7 comments · Opened Jul 19, 2021
Adapt column statistics API Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#717 · 2 comments · Opened Jul 13, 2021
Json inference of multiple files is brittle Open

bug

Difficulty 3/5 1-2 days Newbie friendliness 45/100

apache/datafusion#486 · Opened Jun 3, 2021
Add Linked data benchmarks Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#451 · 6 comments · 1 reaction · Opened May 30, 2021
Publish on conda and nix Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 30/100

apache/datafusion#332 · 8 comments · Opened May 12, 2021
Add support for targets with 32-bit ptrs Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 38/100

apache/datafusion#273 · 1 reaction · Opened May 5, 2021

apache/datafusion

Get new issues in your inbox