apache / apache/datafusion-python
Substrait ExecutionPlan Serialization
- Dominant language
- Python
- Stars
- 604
- Forks
- 174
- Avg merge
- 2d 22h
- Merged PRs (30d)
- 5
Description
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
Serialize physical plans, AKA, `ExecutionPlan`s as Substrait plans.
**Describe the solution you'd like**
Expose Substrait consumers and producers for `ExecutionPlan` to allow for encoding to and decoding to / from Substrait.
**Describe alternatives you've considered**
Using LogicalPlans only.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by locating the Python bindings for ExecutionPlan and any existing Substrait support for LogicalPlans. Review how current plan consumers and producers are exposed, then define the encoding and decoding boundaries for physical plans. Done means ExecutionPlans can be encoded to and decoded from Substrait plans.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100