Owner

datafusion-contrib

22 indexed repositories · View on GitHub

liquid-cache
Pushdown cache for DataFusion

Rust · 452 stars
tpcgen-rs
TPC-H benchmark data generation in pure Rust

Rust · 259 stars
datafusion-table-providers
DataFusion TableProviders for reading data from other systems

Rust · 208 stars
datafusion-dft
Batteries included CLI, TUI, and server implementations for DataFusion.

Rust · 203 stars
datafusion-federation
Allow DataFusion to resolve queries across remote query engines while pushing down as much compute as possible down.

Rust · 195 stars
datafusion-ducklake
A Rust-native DuckLake engine built on Apache DataFusion

Rust · 176 stars
datafusion-postgres
Postgres protocol frontend for DataFusion

Rust · 160 stars
datafusion-distributed
Library for bringing distributed capabilities to Apache DataFusion

Rust · 139 stars
StreamFusion
World's First OSS Flink Accelerator built on Apache DataFusion

Java · 120 stars
datafusion-materialized-views
Incremental view maintenance & query rewriting for materialized views in DataFusion

Rust · 74 stars
geodatafusion
Geometry and Geography Support for Apache DataFusion

Rust · 66 stars
datafusion-functions-json
JSON support for DataFusion (unofficial)

Rust · 62 stars
datafusion-orc
Implementation of Apache ORC file format use Apache Arrow in-memory format

Rust · 47 stars
datafusion-flight-sql-server
DataFusion FlightSQL Server

Rust · 33 stars
orc-rust
Rust implementation of Apache ORC

Rust · 30 stars
arrow-zarr
Implementation of Zarr file format in Rust

Rust · 30 stars
datafusion-tracing
Integration of opentelemetry with the tracing crate

Rust · 27 stars
datafusion-c
C language bindings for DataFusion

C · 22 stars
datafusion-index-provider
Prototype approaches to implementing Indexes in DataFusion

Rust · 17 stars
datafusion-fiddle

Rust · 14 stars
2 more repositories live on View on GitHub

Beginner friendly Everything

Open All

Native collection-returning STRING functions: support REGEXP_EXTRACT_ALL and STR_TO_MAP Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

datafusion-contrib/StreamFusion#219 · Opened Sep 20, 2026
Native binary overloads: support STARTSWITH, ENDSWITH and ELT Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

datafusion-contrib/StreamFusion#218 · Opened Sep 20, 2026
Native STRING helpers: track FROM_BASE64, numeric SPLIT_INDEX, dynamic SHA2 and classification gaps Open

Difficulty 4/5 3-5 days Newbie friendliness 42/100

datafusion-contrib/StreamFusion#217 · Opened Sep 20, 2026
Native trim functions: support column-dependent trim sets Open

Difficulty 4/5 3-5 days Newbie friendliness 58/100

datafusion-contrib/StreamFusion#216 · Opened Sep 20, 2026
Native STRING formatting: support PRINTF Open

Difficulty 4/5 3-5 days Newbie friendliness 55/100

datafusion-contrib/StreamFusion#215 · Opened Sep 20, 2026
Native STRING functions: support PARSE_URL Open

Difficulty 4/5 3-5 days Newbie friendliness 55/100

datafusion-contrib/StreamFusion#214 · Opened Sep 20, 2026
Native regex scalars: support REGEXP and REGEXP_REPLACE/COUNT/INSTR/SUBSTR Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

datafusion-contrib/StreamFusion#213 · Opened Sep 20, 2026
Native string predicates: support LIKE ESCAPE and SIMILAR TO Open

Difficulty 5/5 Over a week Newbie friendliness 42/100

datafusion-contrib/StreamFusion#212 · Opened Sep 20, 2026
Native CAST: support BOOLEAN to STRING/VARCHAR Open

Difficulty 4/5 3-5 days Newbie friendliness 55/100

datafusion-contrib/StreamFusion#211 · Opened Sep 20, 2026
Native IF: admit BOOLEAN result branches Open

Difficulty 4/5 3-5 days Newbie friendliness 55/100

datafusion-contrib/StreamFusion#210 · Opened Sep 20, 2026
Native GREATEST/LEAST: support runtime STRING, mixed exact numerics and TIMESTAMP/LTZ Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

datafusion-contrib/StreamFusion#209 · Opened Sep 20, 2026
Native exact numerics: support DECIMAL unary minus and integral ABS/SIGN/FLOOR/CEIL/TRUNCATE Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

datafusion-contrib/StreamFusion#208 · Opened Sep 20, 2026
[FEATURE] TPCDS Add more correctness coverage for multi-part generation for all tables at SF10 Open

enhancement

datafusion-contrib/tpcgen-rs#457 · 2 comments · 1 reaction · 1 assignee · Opened Sep 19, 2026
Flink 1.18: dual-line CI, upstream suite and release validation Open

Difficulty 4/5 3-5 days Newbie friendliness 64/100

datafusion-contrib/StreamFusion#189 · Opened Sep 19, 2026
Flink 1.18: cross-line savepoint upgrade and mixed-payload safety Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

datafusion-contrib/StreamFusion#188 · Opened Sep 19, 2026
Flink 1.18: connector and format parity matrix Open

Difficulty 1/5 Under an hour Newbie friendliness 90/100

datafusion-contrib/StreamFusion#187 · Opened Sep 19, 2026
Flink 1.18: support Flink 1.18.1 as a production release line Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

datafusion-contrib/StreamFusion#182 · Opened Sep 19, 2026
CI: account for native and fallback routes across upstream SQL tests Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

datafusion-contrib/StreamFusion#168 · Opened Sep 18, 2026
Native window aggregation: support Flink split-distinct physical plans Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

datafusion-contrib/StreamFusion#166 · Opened Sep 18, 2026
Amazing work on this project! From 4.5 hours down to 10 minutes to generate TPCDS 1TB! Open

Difficulty 5/5 Over a week Newbie friendliness 10/100

datafusion-contrib/tpcgen-rs#452 · 2 comments · 2 reactions · Opened Sep 17, 2026
Promote many existing files (and establish a layout) in one commit Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

datafusion-contrib/datafusion-ducklake#323 · Opened Sep 17, 2026
Track native SQL support gaps and parity-harness follow-ups from the September audit Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

datafusion-contrib/StreamFusion#110 · Opened Sep 16, 2026
Native Top-N: support nullable and changing variable rank bounds Open

Difficulty 5/5 Over a week Newbie friendliness 30/100

datafusion-contrib/StreamFusion#104 · Opened Sep 16, 2026
Native retracting OFFSET: preserve upstream stateful mini-batch changelog order Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

datafusion-contrib/StreamFusion#102 · Opened Sep 16, 2026
Native window aggregation: support retracting input from upstream Top-N Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

datafusion-contrib/StreamFusion#99 · Opened Sep 16, 2026
Native SQL/JSON: extend selectors beyond the verified definite-path grammar Open

Difficulty 5/5 Over a week Newbie friendliness 42/100

datafusion-contrib/StreamFusion#91 · Opened Sep 16, 2026
Implement MATCH_RECOGNIZE and pattern time functions Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

datafusion-contrib/StreamFusion#78 · Opened Sep 15, 2026
Paimon streaming source: remaining native snapshot merge coverage Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

datafusion-contrib/StreamFusion#53 · Opened Sep 12, 2026
Include a tiny Parquet fixture and expected results for Flight SQL verification Open

Difficulty 3/5 1-2 days Newbie friendliness 76/100

datafusion-contrib/datafusion-cookbook#17 · Opened Sep 12, 2026
"universal CLI" Open

Difficulty 5/5 Over a week Newbie friendliness 30/100

datafusion-contrib/datafusion-cookbook#16 · Opened Sep 12, 2026
[DISCUSS] / [NOTE] Ideas to make the recipes / prompts easier here Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

datafusion-contrib/datafusion-cookbook#15 · 1 comment · Opened Sep 12, 2026
Add support for CREATE TABLE AS SELECT (CTAS) Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

datafusion-contrib/datafusion-ducklake#308 · Opened Sep 11, 2026
Add pluggable file format and suport for `vortex` Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

datafusion-contrib/datafusion-ducklake#307 · Opened Sep 11, 2026
Plan-time file schema mapping reads one parquet footer per file sequentially Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

datafusion-contrib/datafusion-ducklake#306 · Opened Sep 11, 2026
Propose a Paimon bundle entry on the merge-tree writer with a sequence hand-off Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

datafusion-contrib/StreamFusion#49 · Opened Sep 10, 2026
[FEATURE] CLI flag to specify column sort ordering of a table Open

enhancement

datafusion-contrib/tpcgen-rs#439 · 1 assignee · Opened Sep 8, 2026
[FEATURE] Support generating hive-partitioned parquet files Open

enhancement

datafusion-contrib/tpcgen-rs#438 · 3 comments · 1 assignee · Opened Sep 8, 2026
Paimon sink: take the bundle pass-through path once Paimon stops walking bundles row by row Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 45/100

datafusion-contrib/StreamFusion#39 · Opened Sep 7, 2026
Propose a FileFormatFactory priority upstream to drop the Paimon jar-ordering rule Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 30/100

datafusion-contrib/StreamFusion#38 · Opened Sep 7, 2026
Proposal: Quack table provider crate Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

datafusion-contrib/datafusion-table-providers#737 · Opened Sep 7, 2026
Test query engine on large datasets Open

Difficulty 4/5 3-5 days Newbie friendliness 25/100

datafusion-contrib/arrow-zarr#102 · 1 comment · Opened Sep 7, 2026
Improve spatial query engine, add support for more operations Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

datafusion-contrib/arrow-zarr#101 · 1 comment · Opened Sep 7, 2026
[Epic] Align TPC-H and TPC-DS CLI flags and behavior for v4 Open

Difficulty 5/5 Over a week Newbie friendliness 30/100

datafusion-contrib/tpcgen-rs#423 · 1 comment · Opened Sep 6, 2026
[dynamic filtering] remove network boundary anchors Open

Difficulty 3/5 1-2 days Newbie friendliness 35/100

datafusion-contrib/datafusion-distributed#697 · Opened Sep 4, 2026
Deletion queue shares one column between two id spaces; age-filtered cleanup can leak an object permanently Open

Difficulty 3/5 1-2 days Newbie friendliness 72/100

datafusion-contrib/datafusion-ducklake#298 · Opened Sep 4, 2026
recompute_table_column_stats leaves s.table_id unconstrained, so the stats index cannot serve the per-commit read Open

Difficulty 3/5 1-2 days Newbie friendliness 74/100

datafusion-contrib/datafusion-ducklake#297 · Opened Sep 4, 2026
purge_orphaned_metadata returns no row count, so callers cannot tell a draining sweep from a finished one Open

Difficulty 2/5 1-3 hours Newbie friendliness 74/100

datafusion-contrib/datafusion-ducklake#296 · Opened Sep 4, 2026
DuckDB cannot query a catalog this crate creates: ducklake_snapshot has no next_catalog_id or next_file_id Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

datafusion-contrib/datafusion-ducklake#292 · Opened Sep 3, 2026
Writes into a DuckLake-created SQLite catalog store a NULL data_file_id and leave dangling dependent rows Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

datafusion-contrib/datafusion-ducklake#291 · Opened Sep 3, 2026
CREATE TABLE ... AS SELECT creates the table and silently discards every row Open

Difficulty 4/5 3-5 days Newbie friendliness 70/100

datafusion-contrib/datafusion-ducklake#290 · Opened Sep 3, 2026

Showing the newest 100

This page lists what was indexed most recently. Advanced filter has the whole inventory, narrowed by language, difficulty and how long a task takes.

Open advanced filter

datafusion-contrib

Showing the newest 100

Get new issues in your inbox