apache / apache/gluten

[VL] Merge modules `gluten-arrow` and `backends-velox`

Open
#9,639 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

This will mean merging Velox's CPP code base `cpp/core` and `cpp/velox` altogether at the same time.

We had some discussions like https://github.com/apache/incubator-gluten/issues/4201 which becomes more reasonable over time. At the very beginning, `cpp/core` and `cpp/velox` were split for extensibility purpose, but we don't seem to have chance to leverage this extensibility anymore. ClickHouse backend is unlikely going to rely on `cpp/core` in the future either. Maintaining this extensible design is costly for the community and has no clear reason.

The work will have two parts:

1. Merge Maven module `gluten-arrow` into `backends-velox`.
2. Merge `cpp/core` to `cpp/velox`.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.