apache / apache/datafusion-comet
[datafusion-spark] Test integrating datafusion-spark code into comet
- Dominant language
- Scala
- Stars
- 1.3k
- Forks
- 373
- Avg merge
- 2d 4h
- Merged PRs (30d)
- 198
Description
### What is the problem the feature request solves?
- Part of https://github.com/apache/datafusion/issues/15914
@shehabgamin added the `datafusion-spark` crate in https://github.com/apache/datafusion/pull/15168
The goal is to help centralize the development of this function library in the core repository rather than duplicated effort
To verify this is feasible I would like to verify that the setup created in `datafusion-spark` / https://github.com/apache/datafusion/pull/15168 can be used by downstream crates like comet before we go too far
### Describe the potential solution
I would like someone to make a PR that shows we can remove one or more of the spark function in datafusion-spark can be used in comet (and reduce the code here)
### Additional context
cc @comphead @andygrove @mbutrovich
Contributor guide
Assessment
This issue has not been assessed yet.