apache / apache/gluten

[CORE][VL][CH] Sub-tasks tracker of adding pre/post projections

Open
#4,503 0 comments 2 reactions 0 assignees View on GitHub
enhancement
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

## Description

This tracker consists of sub-tasks for adding a unified way for pulling pre/post projections from SQL plan operators.

Thanks @liujiayi771 @ulysses-you who have already been working on the issue.

## Sub-tasks list

### A. New rules to pull projects - Logical (If necessary)
1. Enable logical rule to pull projects from logical plan nodes

### B. New rules to pull projects - Physical (May be resolved respectively one by one)
1. Add physical rule to pull projects from physical plan nodes, the rule is by default disabled
2. Run tests of CH backend with the rule enabled, to ensure rule is compatible with CH backend @zzcclp
3. Test Velox backend with the rule enabled
4. Enable the rule by default, and remove all the legacy pre/post project code

### C. Incremental optimizations to current code
1. Add Gluten project node when creating Gluten sort transformer
https://github.com/oap-project/gluten/pull/4497

## Related issues and PRs
1. An original issue
https://github.com/oap-project/gluten/issues/4213
2. A related discussion
https://github.com/oap-project/gluten/discussions/4308#discussioncomment-8036736
4. The original PRs
- https://github.com/oap-project/gluten/pull/3649
- https://github.com/oap-project/gluten/pull/4245

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.