apache / apache/datafusion-python

Substrait ExecutionPlan Serialization

Open
#363 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
604
Forks
174
Avg merge
2d 22h
Merged PRs (30d)
5

Description

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
Serialize physical plans, AKA, `ExecutionPlan`s as Substrait plans.

**Describe the solution you'd like**
Expose Substrait consumers and producers for `ExecutionPlan` to allow for encoding to and decoding to / from Substrait.

**Describe alternatives you've considered**
Using LogicalPlans only.

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the Python bindings for ExecutionPlan and any existing Substrait support for LogicalPlans. Review how current plan consumers and producers are exposed, then define the encoding and decoding boundaries for physical plans. Done means ExecutionPlans can be encoded to and decoded from Substrait plans.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
data-engineering
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.