datafusion-contrib / datafusion-contrib/liquid-cache
Support substrait as query plan representation
Open
@Raja-2799 is already working on this.
Since Sep 23, 2025.
help wanted
- Dominant language
- Rust
- Stars
- 452
- Forks
- 51
- Avg merge
- 3h 10m
- Merged PRs (30d)
- 12
Description
Substrait is becoming the new standard for query plan representation: https://substrait.io
It allows cross-engine query execution.
If we support substrait, we can have cool stuff like supporting DuckDB/Spark/ClickHouse in addition to DataFusion.
In fact, DataFusion already supports substrait: https://github.com/apache/datafusion/tree/main/datafusion/substrait
I'm not sure:
- Substrait in DataFusion may not be mature enough
- Substrait in other systems may also be quite bad, so it is a second-tier best-effort approach, with DataFusion query plan as the first tier.
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.