apache / apache/datafusion

Integrate with the substrait integration test

Open
#10,710 14 comments 0 reactions 0 assignees View on GitHub
enhancement substrait
Dominant language
Rust
Stars
9.3k
Forks
2.4k
Avg merge
3d 7h
Merged PRs (30d)
344

Description

### Is your feature request related to a problem or challenge?

In https://github.com/apache/datafusion/pull/10653, @Blizzara added the beginnings of testing for substrait plans that came from other systems.

@richtia noted https://github.com/apache/datafusion/pull/10653#issuecomment-2136031347

> FYI...The substrait project also has a repo that aims to do integration testing between different substrait producers/consumers. https://github.com/substrait-io/consumer-testing

### Describe the solution you'd like

I would like to get DataFusion working with that substrait integration test

### Describe alternatives you've considered

_No response_

### Additional context

_No response_

Contributor guide

Open the contributing guide

Research direction

Start by reviewing Apache DataFusion PR 10653 and the Substrait consumer-testing repository linked in the issue. Determine the integration-test requirements and the DataFusion changes needed; done means DataFusion works with that Substrait integration test.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
backend, testing-qa
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
32/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.