apache/datafusion

View on GitHub

Apache DataFusion SQL Query Engine

Stars: 9.3k
Forks: 2.4k
Open beginner issues: 0
Indexed issues: 1.8k
Avg merge: 3d 6h
Merged PRs (30d): 363

Dominant language: Rust
License: Apache-2.0
Last GitHub push: Sep 19, 2026
Latest indexed: Sep 14, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue help wanted

Beginner friendly Everything

Open All

1,799 open issues indexed

support `skip_rows` for `CsvFormat` Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 48/100

apache/datafusion#8824 · 13 comments · 1 reaction · Opened Jan 10, 2024
Add test coverage for grouping on dictionary encoded columns Open

enhancement

apache/datafusion#8791 · 2 comments · 1 assignee · Opened Jan 8, 2024
Support autocomplet for datafusion-cli Open

enhancement help wanted

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#8783 · 2 comments · Opened Jan 8, 2024
Avoid recompute CTEs (common table expressions) / share input plans Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#8777 · 16 comments · 3 reactions · Opened Jan 7, 2024
Improve Parallel Reading (CSV, JSON) / Help Wanted Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 32/100

apache/datafusion#8723 · 6 comments · 1 reaction · Opened Jan 2, 2024
datafusion-cli: implement syntax highlighting for keywords/literals Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 35/100

apache/datafusion#8701 · 4 comments · 2 reactions · Opened Jan 1, 2024
Better Grouping / aggregation pushdown Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 30/100

apache/datafusion#8699 · 7 comments · 1 reaction · Opened Dec 31, 2023
Implement statistics support for Substrait Open

enhancement substrait

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#8698 · 7 comments · 1 reaction · Opened Dec 31, 2023
Implement the `contained` method of `RowGroupPruningStatistics` introduce by #8440 Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 50/100

apache/datafusion#8668 · 1 reaction · Opened Dec 28, 2023
Support Configuring arrow_ipc::FileWriter via ArrowWriterOptions Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 45/100

apache/datafusion#8635 · 1 comment · Opened Dec 22, 2023
Add serde support for advanced WriterProperties Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 48/100

apache/datafusion#8632 · Opened Dec 22, 2023
Config the length of list when using In_list on parquet, rather than a const of 20. Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 38/100

apache/datafusion#8609 · 7 comments · Opened Dec 21, 2023
Test protobuf generation in CI Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 38/100

apache/datafusion#8607 · Opened Dec 20, 2023
Support multiple order aware aggregate functions in a query Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#8582 · 5 comments · Opened Dec 19, 2023
Spacial Data: S2 cell ID Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

apache/datafusion#8579 · Opened Dec 18, 2023
Discuss: Speeding up LogicalPlan manipulation by skipping validation Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#8556 · Opened Dec 15, 2023
Make the `tdigest` public Open

enhancement

Difficulty 2/5 1-3 hours Newbie friendliness 38/100

apache/datafusion#8554 · 4 comments · Opened Dec 15, 2023
Convert list operator to function in `sql_expr_to_logical_expr` Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#8506 · 2 comments · 1 reaction · Opened Dec 12, 2023
feat: make `parse_float_as_decimal` work on scientific notaion Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 35/100

apache/datafusion#8486 · 5 comments · Opened Dec 10, 2023
Support AND operator as alias of list intersect/array intersect function like Duckdb Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 42/100

apache/datafusion#8483 · 2 comments · Opened Dec 9, 2023
Discussion: handling comparison of intervals Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#8468 · 3 comments · 1 reaction · Opened Dec 8, 2023
[Epic] A collection of Join Improvements Open

enhancement PROPOSAL EPIC

Difficulty 5/5 Over a week Newbie friendliness 20/100

apache/datafusion#8398 · 7 reactions · Opened Dec 1, 2023
Range/inequality joins are slow Open

bug

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#8393 · 11 comments · 2 reactions · Opened Dec 1, 2023
Support User Defined Table Functions that read from input columns Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#8383 · 2 reactions · Opened Nov 30, 2023
Consider introducing unique expression IDs in Logical/Physical plan Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

apache/datafusion#8379 · 9 comments · 1 reaction · Opened Nov 30, 2023
Cannot cast `Large` Types to normal arrow types Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#8372 · 4 comments · Opened Nov 30, 2023
String compare for Substrait roundtrip check Open

bug substrait

Difficulty 3/5 1-2 days Newbie friendliness 45/100

apache/datafusion#8361 · 6 comments · Opened Nov 29, 2023
Parquet Statistics Pruning Ignores ColumnOrder, resulting in potentially incorrect statistics Open

bug

apache/datafusion#8342 · 5 comments · 1 reaction · 1 assignee · Opened Nov 28, 2023
Support parquet statistics for struct columns Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 45/100

apache/datafusion#8334 · 9 comments · 1 reaction · Opened Nov 27, 2023
Improve type coercion and casting Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#8302 · 18 comments · Opened Nov 22, 2023
[EPIC] Additional Date/Time related open issues Open

enhancement PROPOSAL EPIC

Difficulty 5/5 Over a week Newbie friendliness 20/100

apache/datafusion#8282 · 3 comments · 1 reaction · Opened Nov 20, 2023
Enhance SortMergeJoinExec by implementing EagerJoinStream for the join Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#8273 · 1 comment · Opened Nov 20, 2023
File 'supplier.parquet' does not match the expected extension '.parquet' Open

bug

Difficulty 2/5 1-3 hours Newbie friendliness 45/100

apache/datafusion#8264 · 2 comments · Opened Nov 18, 2023
Incorrect results for NOT IN subqueries with nulls Open

bug

Difficulty 5/5 Over a week Newbie friendliness 30/100

apache/datafusion#8241 · 7 comments · 2 reactions · Opened Nov 16, 2023
Consolidate statistics aggregation Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 38/100

apache/datafusion#8229 · 5 comments · Opened Nov 15, 2023
Improve statistics test coverage Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#8228 · 1 comment · 1 reaction · Opened Nov 15, 2023
Epic: Statistics improvements Open

enhancement PROPOSAL EPIC

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#8227 · 17 comments · Opened Nov 15, 2023
File IO on Tokio Workers Open

bug

apache/datafusion#8188 · 1 assignee · Opened Nov 15, 2023
Refactoring of array_set operations (array_union, array_except, array_intersection) Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#8156 · 6 comments · Opened Nov 13, 2023
Compute column statistics min & max for FilterExec and beyond Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#8155 · 2 comments · Opened Nov 13, 2023
Overlapping `ExecutionPlan::maintains_input_order(), equivalence_properties and maintains_input_order` are confusing Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#8120 · 4 comments · Opened Nov 10, 2023
Ensure tmp files are cleaned up after tests in CI Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 35/100

apache/datafusion#8116 · Opened Nov 10, 2023
Push limit into aggregation when nested GROUP BY expressions are equivalent but not identical Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 30/100

apache/datafusion#8101 · Opened Nov 9, 2023
Queries that lost statistics or their statistics become inexact Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#8099 · 6 comments · 1 reaction · Opened Nov 8, 2023
Allow user defined ExecutionPlans to benefit from pushdown behavior Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#8096 · 2 comments · Opened Nov 8, 2023
Introduce a way to represent constrained statistics / bounds on values in Statistics Open

enhancement

apache/datafusion#8078 · 44 comments · 1 assignee · Opened Nov 7, 2023
Unifying Projections with File Reader Execs Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#8075 · 2 comments · Opened Nov 7, 2023
Proposal: Change `Accumulator` trait to accept `RecordBatch` / `num_rows` to allow faster `Count` Open

api change enhancement performance

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#8067 · 4 comments · 2 reactions · Opened Nov 6, 2023
Improve Sort Based Optimizations Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#8064 · 3 reactions · Opened Nov 6, 2023
Specialized / Pre-compiled / Prepared ScalarUDFs Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#8051 · 19 comments · Opened Nov 4, 2023

apache/datafusion

Get new issues in your inbox