apache / apache/datafusion-comet

[datafusion-spark] Test integrating datafusion-spark code into comet

Open
#1,704 5 comments 3 reactions 0 assignees View on GitHub
enhancement
Dominant language
Scala
Stars
1.3k
Forks
373
Avg merge
2d 4h
Merged PRs (30d)
198

Description

### What is the problem the feature request solves?

- Part of https://github.com/apache/datafusion/issues/15914

@shehabgamin added the `datafusion-spark` crate in https://github.com/apache/datafusion/pull/15168

The goal is to help centralize the development of this function library in the core repository rather than duplicated effort

To verify this is feasible I would like to verify that the setup created in `datafusion-spark` / https://github.com/apache/datafusion/pull/15168 can be used by downstream crates like comet before we go too far

### Describe the potential solution

I would like someone to make a PR that shows we can remove one or more of the spark function in datafusion-spark can be used in comet (and reduce the code here)

### Additional context

cc @comphead @andygrove @mbutrovich

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.