datafusion-contrib

datafusion-contrib/datafusion-distributed

Library for bringing distributed capabilities to Apache DataFusion

Stars: 139
Forks: 67
Open beginner issues: 0
Indexed issues: 62
Avg merge: 3d 1h
Merged PRs (30d): 35

Dominant language: Rust
License: Apache-2.0
Last GitHub push: Sep 18, 2026
Latest indexed: Sep 20, 2026
Contributing guide: No contributing guide
Code of conduct: No code of conduct
Beginner labels: good first issue

Beginner friendly Everything

Open All

62 open issues indexed

[dynamic filtering] remove network boundary anchors Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

datafusion-contrib/datafusion-distributed#697 · Opened Sep 4, 2026
worker: stop swallowing errors in worker -> coordinator task Open

Difficulty 3/5 1-2 days Newbie friendliness 48/100

datafusion-contrib/datafusion-distributed#686 · 1 comment · Opened Aug 31, 2026
Add a non-blocking snapshot API for available distributed task metrics Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

datafusion-contrib/datafusion-distributed#685 · Opened Aug 27, 2026
add a better display API Open

Difficulty 5/5 Over a week Newbie friendliness 45/100

datafusion-contrib/datafusion-distributed#678 · Opened Aug 25, 2026
[dynamic filtering] display dynamic filters for producers Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

datafusion-contrib/datafusion-distributed#677 · Opened Aug 25, 2026
Add forced-spill broadcast NestedLoopJoin regression coverage Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

datafusion-contrib/datafusion-distributed#674 · Opened Aug 25, 2026
[dynamic filtering] add docs Open

Difficulty 3/5 1-2 days Newbie friendliness 68/100

datafusion-contrib/datafusion-distributed#666 · Opened Aug 23, 2026
[dynamic filtering] merge and forward updates for non complete dynamic filters Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

datafusion-contrib/datafusion-distributed#665 · Opened Aug 23, 2026
[dynamic filtering] dynamic planning stats aren't accurate with dynamic filtering Open

Difficulty 4/5 3-5 days Newbie friendliness 42/100

datafusion-contrib/datafusion-distributed#664 · Opened Aug 23, 2026
Preserve and reuse shared physical subplans across distributed task specialization Open

Difficulty 5/5 Over a week Newbie friendliness 32/100

datafusion-contrib/datafusion-distributed#663 · 1 comment · Opened Aug 21, 2026
implement `replace_children` for all `ExecutinoPlan` implementations Open

good first issue

Difficulty 3/5 1-2 days Newbie friendliness 58/100

datafusion-contrib/datafusion-distributed#657 · Opened Aug 19, 2026
[AQE] Reorder join trees using runtime cardinality statistics Open

Difficulty 5/5 Over a week Newbie friendliness 38/100

datafusion-contrib/datafusion-distributed#641 · Opened Aug 13, 2026
Allow workers to reject work for a query (before side effects) Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

datafusion-contrib/datafusion-distributed#640 · 9 comments · Opened Aug 13, 2026
[Benchmark datasets] Add a sorted ClickBench benchmark dataset Open

Difficulty 4/5 3-5 days Newbie friendliness 55/100

datafusion-contrib/datafusion-distributed#633 · Opened Aug 13, 2026
[Benchmark datasets] Support TPC-DS benchmark scale factors beyond SF1 Open

Difficulty 3/5 1-2 days Newbie friendliness 64/100

datafusion-contrib/datafusion-distributed#631 · Opened Aug 13, 2026
[EPIC] Add other benchmarking datasets Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

datafusion-contrib/datafusion-distributed#629 · Opened Aug 13, 2026
tests and benchmarks on range partitioned data Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

datafusion-contrib/datafusion-distributed#628 · 4 comments · Opened Aug 12, 2026
[Iceberg] Commit append transactions Open

Difficulty 4/5 3-5 days Newbie friendliness 55/100

datafusion-contrib/datafusion-distributed#616 · Opened Aug 9, 2026
[Iceberg] Write data files for append inserts Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

datafusion-contrib/datafusion-distributed#615 · Opened Aug 9, 2026
[Iceberg] Plan append inserts into catalog-backed tables Open

Difficulty 3/5 1-2 days Newbie friendliness 66/100

datafusion-contrib/datafusion-distributed#614 · Opened Aug 9, 2026
[Iceberg] Support Iceberg metadata tables Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

datafusion-contrib/datafusion-distributed#613 · 1 comment · Opened Aug 9, 2026
[Iceberg] Support CREATE TABLE and DROP TABLE through Iceberg catalogs Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

datafusion-contrib/datafusion-distributed#612 · Opened Aug 9, 2026
[Iceberg] Add catalog and schema providers Open

datafusion-contrib/datafusion-distributed#611 · 1 comment · 1 assignee · Opened Aug 9, 2026
[Iceberg] Support sort-order pushdown Open

Difficulty 4/5 3-5 days Newbie friendliness 68/100

datafusion-contrib/datafusion-distributed#610 · 2 comments · Opened Aug 9, 2026
[Iceberg] Support physical filter pushdown Open

Difficulty 4/5 3-5 days Newbie friendliness 65/100

datafusion-contrib/datafusion-distributed#609 · 2 comments · Opened Aug 9, 2026
[Iceberg] Support partitioning in work-unit feeds Open

datafusion-contrib/datafusion-distributed#606 · 2 comments · 1 assignee · Opened Aug 9, 2026
[Iceberg] Add remote benchmarks Open

datafusion-contrib/datafusion-distributed#602 · 1 comment · 1 assignee · Opened Aug 9, 2026
[EPIC] Iceberg integration Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

datafusion-contrib/datafusion-distributed#599 · 3 comments · Opened Aug 9, 2026
[Epic] Abstract transportation protocol details Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

datafusion-contrib/datafusion-distributed#580 · Opened Jul 30, 2026
[Abstract protocol] Make tests work with gRPC enabled and disabled Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

datafusion-contrib/datafusion-distributed#579 · Opened Jul 30, 2026
[Abstract protocol] Move non-gRPC protobuf messages to protobuf/ Open

Difficulty 3/5 1-2 days Newbie friendliness 66/100

datafusion-contrib/datafusion-distributed#577 · Opened Jul 30, 2026
retry tasks on error Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

datafusion-contrib/datafusion-distributed#575 · 1 comment · Opened Jul 29, 2026
Allow DesiredTaskCountHandler to return f64 as desired task counts Open

good first issue

Difficulty 3/5 1-2 days Newbie friendliness 68/100

datafusion-contrib/datafusion-distributed#562 · 1 comment · Opened Jul 23, 2026
Expose worker task-cache lifecycle controls and per-task invalidation Open

Difficulty 5/5 Over a week Newbie friendliness 38/100

datafusion-contrib/datafusion-distributed#551 · 1 comment · Opened Jul 13, 2026
Decouple WorkerChannel from http headers Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

datafusion-contrib/datafusion-distributed#544 · Opened Jul 9, 2026
Support open-table formats Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

datafusion-contrib/datafusion-distributed#533 · 16 comments · Opened Jul 4, 2026
[dynamic filtering] 4. implement remote dynamic filtering Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

datafusion-contrib/datafusion-distributed#532 · Opened Jul 2, 2026
[dynamic filtering] 3. benchmark / tests for distributed dynamic filtering local case Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

datafusion-contrib/datafusion-distributed#531 · Opened Jul 2, 2026
[EPIC] dynamic filtering Open

datafusion-contrib/datafusion-distributed#528 · 1 assignee · Opened Jul 2, 2026
Add a standard compressed serialized representation of plans with metrics Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

datafusion-contrib/datafusion-distributed#523 · 1 comment · Opened Jul 1, 2026
[Epic][part 2] Adaptive Query Execution, runtime plan optimization Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

datafusion-contrib/datafusion-distributed#522 · Opened Jul 1, 2026
Leverage memory and network cost for dynamic task count decisions Open

Difficulty 5/5 Over a week Newbie friendliness 48/100

datafusion-contrib/datafusion-distributed#520 · Opened Jul 1, 2026
Add unit tests for SamplerExec Open

datafusion-contrib/datafusion-distributed#518 · 1 assignee · Opened Jul 1, 2026
Allow custom physical operators to opt into NetworkCoalesce boundary placement Open

Difficulty 5/5 Over a week Newbie friendliness 45/100

datafusion-contrib/datafusion-distributed#513 · Opened Jun 30, 2026
Ensure the project is good for docs.rs Open

Difficulty 3/5 1-2 days Newbie friendliness 45/100

datafusion-contrib/datafusion-distributed#495 · Opened Jun 11, 2026
Investigate if ScalarSubqueryExec can replace network broadcasts Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

datafusion-contrib/datafusion-distributed#474 · Opened May 29, 2026
Support for `ScalarSubqueryExec` and `ScalarSubqueryExpr` Open

Difficulty 5/5 Over a week Newbie friendliness 30/100

datafusion-contrib/datafusion-distributed#471 · 1 reaction · Opened May 28, 2026
handle non-deterministic queries in ClickBench test Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

datafusion-contrib/datafusion-distributed#458 · 2 comments · Opened May 19, 2026
`WorkerResolver` API Redesign: Built-in worker version filtering Open

datafusion-contrib/datafusion-distributed#393 · 1 assignee · Opened Mar 31, 2026
Improve shuffling performance Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

datafusion-contrib/datafusion-distributed#385 · 5 comments · Opened Mar 23, 2026

A short digest of beginner-friendly GitHub issues.