apache / apache/datafusion-python
Add support to consume byte format and json formatted substrait plans.
- Dominant language
- Python
- Stars
- 604
- Forks
- 174
- Avg merge
- 1d 7h
- Merged PRs (30d)
- 4
Description
The datafusion-python substrait consumer seems to be only able to create dataframes from a deserialized logical plan:
https://github.com/apache/arrow-datafusion-python/blob/9ef0a57bd4733fb8314c9aa8ae5408a7411cb004/datafusion/tests/test_substrait.py#L55C1-L55C1
Whereas other substrait consumers are accepting the byte format or json format substrait plans.
Contributor guide
No contributing guide indexed for this repository
Research direction
Start with the linked test in datafusion/tests/test_substrait.py and read the surrounding Substrait consumer behavior. Verify completion by exercising equivalent byte-format and JSON-format plans, with tests showing that both can create dataframes.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- backend
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 42/100