apache/datafusion

View on GitHub

Apache DataFusion SQL Query Engine

Stars: 9.3k
Forks: 2.4k
Open beginner issues: 0
Indexed issues: 1.8k
Avg merge: 3d 6h
Merged PRs (30d): 363

Dominant language: Rust
License: Apache-2.0
Last GitHub push: Sep 19, 2026
Latest indexed: Sep 14, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue help wanted

Beginner friendly Everything

Open All

1,802 open issues indexed

Implement method to apply scalar or aggregate function to Array elements Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 30/100

apache/datafusion#15882 · 3 comments · 1 reaction · Opened Apr 28, 2025
An error occurs when ordering by an aggregate function (like AVG) that is not included in the SELECT list. Open

bug

apache/datafusion#15875 · 1 comment · 1 assignee · Opened Apr 28, 2025
support `regexp_match` as predicate Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 35/100

apache/datafusion#15872 · 8 comments · Opened Apr 27, 2025
Tracking: improve aggreagation fuzzer Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 25/100

apache/datafusion#15870 · Opened Apr 27, 2025
`select count(distinct ..)` query doesn't go to the specialized distinct accumulator Open

enhancement performance

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#15850 · 2 comments · Opened Apr 25, 2025
`physical_planner::tests::test_optimization_invariant_checker` fails on `release-nonlto` profile but not `test` profile Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 40/100

apache/datafusion#15848 · Opened Apr 25, 2025
Cannot use Projection::new_from_schema to set parquet field ids. Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 42/100

apache/datafusion#15837 · 2 comments · Opened Apr 24, 2025
Sorting is not maintained after using a window function Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 42/100

apache/datafusion#15833 · 5 comments · Opened Apr 23, 2025
Custom sort order for column Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#15819 · 1 comment · Opened Apr 23, 2025
Bring ordering information for grouped aggregation Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#15818 · 2 comments · Opened Apr 23, 2025
Improve `candidate functions` suggestions Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#15817 · Opened Apr 23, 2025
Pruning of floating point Parquet columns is incorrect when `NaN` is present Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#15812 · 9 comments · Opened Apr 22, 2025
Deprecate ExprSchema functions Open

enhancement good first issue

apache/datafusion#15798 · 5 comments · 2 assignees · Opened Apr 21, 2025
Remove nulls in joins during hash table lookup Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 28/100

apache/datafusion#15784 · 3 comments · 1 reaction · Opened Apr 20, 2025
Tracking: speed up the logical optimizer Open

performance

apache/datafusion#15775 · 2 comments · 3 reactions · 1 assignee · Opened Apr 19, 2025
Move code in `user_defined_plan.rs` to the `extending-operators` doc Open

good first issue

Difficulty 3/5 1-2 days Newbie friendliness 35/100

apache/datafusion#15774 · 7 comments · Opened Apr 19, 2025
Memory limited nest loop join Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#15760 · 4 comments · Opened Apr 18, 2025
GROUP BY constant with aggregation function and with empty input magically summons a row Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 55/100

apache/datafusion#15734 · 4 comments · Opened Apr 16, 2025
Support expression based window function (value based `RANGE`) Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 48/100

apache/datafusion#15714 · 2 comments · Opened Apr 15, 2025
API to match against any error in chain Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#15713 · Opened Apr 14, 2025
Should we add a "breaking change" label in GitHub? Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#15678 · 1 comment · 3 reactions · Opened Apr 10, 2025
Benchmark / program to test Spilling Sorts Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#15664 · 1 reaction · Opened Apr 9, 2025
deprecating `return_type` in favor of `return_fields_from_args` Open

Difficulty 5/5 Over a week Newbie friendliness 30/100

apache/datafusion#15662 · 2 comments · Opened Apr 9, 2025
Linear Aggregate Functions Optimization Open

apache/datafusion#15633 · 15 comments · 1 reaction · 1 assignee · Opened Apr 8, 2025
Improve the performance of early exit evaluation in binary_expr Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#15631 · 14 comments · Opened Apr 8, 2025
Reduce the `clone()` cost of `Statistics` by caching Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 25/100

apache/datafusion#15614 · 1 reaction · Opened Apr 7, 2025
Vectorize window functions (`GroupsAccumulator`-style) Open

performance

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#15607 · 13 comments · 8 reactions · Opened Apr 6, 2025
Support multi-partitions when compiling DataFusion to `wasm` target Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 38/100

apache/datafusion#15599 · 4 comments · Opened Apr 5, 2025
Use a pager for query results in datafusion-cli Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#15596 · 1 comment · Opened Apr 5, 2025
Filter cache based on the paper "Predicate Caching: Query-Driven Secondary Indexing for Cloud Data" Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#15585 · 6 comments · 2 reactions · Opened Apr 4, 2025
Support Nested correlated subquery error with a depth exceeding 1 Open

bug

apache/datafusion#15558 · 9 comments · 1 assignee · Opened Apr 3, 2025
Support spilling in `TopK` queries Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

apache/datafusion#15538 · 1 comment · 3 reactions · Opened Apr 2, 2025
Enable sort query fuzzing with limited memory Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 40/100

apache/datafusion#15517 · 1 comment · Opened Apr 1, 2025
[Epic] Dynamic filtering related items Open

enhancement PROPOSAL EPIC

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#15512 · 14 comments · 3 reactions · Opened Mar 31, 2025
Run all benchmarks on merge to main branch Open

enhancement

apache/datafusion#15511 · 13 comments · 1 assignee · Opened Mar 31, 2025
Improve `String` to `&str` conversions Open

enhancement

apache/datafusion#15498 · 8 comments · 1 assignee · Opened Mar 30, 2025
Add missing error macro Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 38/100

apache/datafusion#15491 · 1 comment · 1 reaction · Opened Mar 30, 2025
Add method to perform all sql tests via FFI wrapped functions Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#15488 · Opened Mar 29, 2025
Provide a helper function for merging statistics Open

apache/datafusion#15474 · 1 comment · 1 assignee · Opened Mar 28, 2025
Question: can we collect statistic if the table doesn't collect statistic during creating Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#15455 · 3 comments · Opened Mar 27, 2025
Move `optimize_subquery_sort` into optimizer as a new rule `EliminateSort` Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

apache/datafusion#15435 · 4 comments · Opened Mar 26, 2025
Avoid evaluating filters when they can be discarded purely from statistics Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#15425 · 4 comments · 3 reactions · Opened Mar 25, 2025
Add selection vector repartitioning Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 42/100

apache/datafusion#15420 · 4 comments · Opened Mar 25, 2025
Investigate why Utf8View performs worse for sort with high cardinality cases and improve it. Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

apache/datafusion#15402 · 2 comments · Opened Mar 25, 2025
Scalars are too verbose in column name output Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 35/100

apache/datafusion#15395 · 10 comments · 2 reactions · Opened Mar 24, 2025
Each Union branch should produce fields with `nullable: true` if any of the branches produces fields with `nullable: true` on the same position Open

bug

Difficulty 3/5 1-2 days Newbie friendliness 45/100

apache/datafusion#15394 · 2 comments · Opened Mar 24, 2025
Support zero copy hash repartitioning for Hash Aggregate Open

enhancement performance

apache/datafusion#15383 · 9 comments · 1 assignee · Opened Mar 24, 2025
Support zero copy hash repartitioning for Hash Join Open

enhancement performance

apache/datafusion#15382 · 8 comments · 1 assignee · Opened Mar 24, 2025
Perf: Support automatically concat_batches for sort which will improve performance Open

enhancement

apache/datafusion#15375 · 7 comments · 1 assignee · Opened Mar 24, 2025
Refactor `SortExec`'s buffered batches for better code readability Open

enhancement

apache/datafusion#15372 · 1 comment · 1 assignee · Opened Mar 24, 2025

apache/datafusion

Get new issues in your inbox