apache/datafusion

View on GitHub

Apache DataFusion SQL Query Engine

Stars: 9.3k
Forks: 2.4k
Open beginner issues: 0
Indexed issues: 1.8k
Avg merge: 3d 6h
Merged PRs (30d): 363

Dominant language: Rust
License: Apache-2.0
Last GitHub push: Sep 20, 2026
Latest indexed: Sep 14, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue help wanted

Beginner friendly Everything

Open All

1,799 open issues indexed

Async CatalogProviderList and CatalogProvider trait Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#9918 · 5 comments · Opened Apr 3, 2024
Create physical scalar expression in `functions` modules from string (name) Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#9892 · 16 comments · 1 reaction · Opened Mar 31, 2024
Macro based scalar function definitions make IDE harder to trace function usage Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#9880 · 1 comment · Opened Mar 31, 2024
CI does not run RAT check against files under `.github` directory Open

bug

Difficulty 3/5 1-2 days Newbie friendliness 45/100

apache/datafusion#9851 · Opened Mar 29, 2024
Ensure ExecutionPlan nodes have unique names Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#9840 · Opened Mar 28, 2024
Incorrect results: Bloom filters on `UInt8`, `Int8`, `UInt16` and `Int16` columns always return false negatives Open

bug waiting-on-upstream

Difficulty 3/5 1-2 days Newbie friendliness 35/100

apache/datafusion#9779 · 6 comments · Opened Mar 24, 2024
track of column references for common expr Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

apache/datafusion#9776 · 1 comment · Opened Mar 24, 2024
Run sqllogictests multiple times with random fuzzed configurations Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 45/100

apache/datafusion#9746 · 1 comment · 1 reaction · Opened Mar 23, 2024
Can not handle `'` characters in PARTITIONED BY clause Open

bug

Difficulty 3/5 1-2 days Newbie friendliness 45/100

apache/datafusion#9714 · 3 comments · Opened Mar 20, 2024
Avoid cast numbers to string in filter Open

enhancement

apache/datafusion#9671 · 4 comments · 1 reaction · 1 assignee · Opened Mar 18, 2024
Simplify CI benchmark comparison development Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#9638 · 1 comment · 1 reaction · Opened Mar 16, 2024
Replace `Box`es with `Arc` in the `Expr` `enum`. Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#9577 · 17 comments · 2 reactions · Opened Mar 12, 2024
Keep track of common sub-expression across logical plan nodes Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#9576 · 5 comments · Opened Mar 12, 2024
Generate GroupByHash output in multiple `RecordBatch`es rather than one large one Open

enhancement

apache/datafusion#9562 · 13 comments · 4 reactions · 1 assignee · Opened Mar 11, 2024
Efficiency Problem: Parallelization and vectorization Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#9547 · 5 comments · 1 reaction · Opened Mar 11, 2024
Supporting using parallel parquet writer outside of Datafusion query execution Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#9493 · 13 comments · Opened Mar 7, 2024
offset command not working as expected Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#9488 · 3 comments · Opened Mar 7, 2024
Optimize `try_embed_to_hash_join` in the ProjectionPushdown rule Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 25/100

apache/datafusion#9483 · Opened Mar 6, 2024
Further refine the Top K sort operator Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#9417 · 19 comments · Opened Mar 1, 2024
Support more temporary table construct Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

apache/datafusion#9354 · 3 comments · Opened Feb 27, 2024
Complete substrait support for ParquetExec round trip Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#9347 · 1 comment · Opened Feb 26, 2024
Create separate Rust crate for CI checks Open

development-process enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#9338 · Opened Feb 25, 2024
support more date inferences in the csv reader Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#9331 · 4 comments · Opened Feb 24, 2024
WASM UDFs Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#9326 · 16 comments · 18 reactions · Opened Feb 23, 2024
feat: allow math functions to parse input from Utf8 Open

enhancement

apache/datafusion#9302 · 16 comments · 1 assignee · Opened Feb 21, 2024
Can't serialize example `ExecutionPlan` to substrait Open

documentation enhancement substrait

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#9299 · 4 comments · Opened Feb 21, 2024
Make sql_expr_to_logical_expr able to parse SQLExpr::JsonAccess Open

enhancement

Difficulty 2/5 1-3 hours Newbie friendliness 55/100

apache/datafusion#9296 · Opened Feb 21, 2024
Panic when reading from partitioned datasets with columns that have `'` in them Open

bug

Difficulty 3/5 1-2 days Newbie friendliness 45/100

apache/datafusion#9269 · 2 comments · Opened Feb 19, 2024
Remove fetch option from ExternalSorter Open

enhancement

Difficulty 2/5 1-3 hours Newbie friendliness 55/100

apache/datafusion#9266 · 4 comments · 1 reaction · Opened Feb 19, 2024
Support array sort for nested array Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#9252 · Opened Feb 16, 2024
Convert indexed ARRAY_AGG to NTH_VALUE Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#9213 · 6 comments · Opened Feb 13, 2024
Improved performance for streaming grouping with single string columns Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 42/100

apache/datafusion#9195 · 2 comments · Opened Feb 11, 2024
`COLLATION` Support Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 30/100

apache/datafusion#9192 · 10 comments · 1 reaction · Opened Feb 10, 2024
Implement spilling for PartialSortExec Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#9170 · 2 comments · Opened Feb 9, 2024
Expand PartialSort usage in more queries to reduce memory usage Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 30/100

apache/datafusion#9153 · 1 reaction · Opened Feb 7, 2024
Projection pushdown doesn't work for User Defined plan Nodes Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 42/100

apache/datafusion#9146 · 2 comments · Opened Feb 7, 2024
Registering a record batch with the name json_table causes ParserError Open

bug waiting-on-upstream

Difficulty 3/5 1-2 days Newbie friendliness 35/100

apache/datafusion#9122 · 7 comments · Opened Feb 4, 2024
A More General Approach for Optimizing Projections in Physical Plans Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

apache/datafusion#9111 · 10 comments · Opened Feb 2, 2024
support list slicing with negative index Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#9036 · 2 comments · Opened Jan 29, 2024
Document streaming usecase (like `UNBOUNDED` tables) Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 58/100

apache/datafusion#9016 · 18 comments · 5 reactions · Opened Jan 27, 2024
Extra repartitions in physical plan and strange optimizer behavior overall Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#9011 · 5 comments · Opened Jan 26, 2024
Additional `IN` / `NOT IN` simplifications Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

apache/datafusion#8970 · 3 comments · Opened Jan 23, 2024
`NestedLoopsJoin` memory tracking may be insufficient Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 38/100

apache/datafusion#8952 · 3 comments · Opened Jan 22, 2024
Support bloom filter pruning in parquet benchmark Open

Difficulty 4/5 3-5 days Newbie friendliness 20/100

apache/datafusion#8931 · Opened Jan 21, 2024
How to provide a custom `Context` in `TableProvider`'s `scan`? Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#8926 · 6 comments · Opened Jan 21, 2024
Epic: Implement remaining `information_schema` tables Open

enhancement PROPOSAL EPIC

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#8916 · Opened Jan 19, 2024
Support "standard" / alternate format arguments for `to_timestamp` Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#8915 · 8 comments · Opened Jan 19, 2024
No efficient way to load a subset of files from partitioned table Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#8906 · 9 comments · Opened Jan 18, 2024
Stack Overflow with Deeply Nested Filter Expressions Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#8900 · 4 comments · Opened Jan 18, 2024
Add Scalar to ScalarValue Nested Type Open

apache/datafusion#8846 · 2 comments · 1 reaction · 1 assignee · Opened Jan 13, 2024

apache/datafusion

Get new issues in your inbox