[CORE][VL][CH] Sub-tasks tracker of adding pre/post projections
- Dominant language
- Scala
- Stars
- 1.6k
- Forks
- 657
- Avg merge
- 2d 14h
- Merged PRs (30d)
- 80
Description
## Description
This tracker consists of sub-tasks for adding a unified way for pulling pre/post projections from SQL plan operators.
Thanks @liujiayi771 @ulysses-you who have already been working on the issue.
## Sub-tasks list
### A. New rules to pull projects - Logical (If necessary)
1. Enable logical rule to pull projects from logical plan nodes
### B. New rules to pull projects - Physical (May be resolved respectively one by one)
1. Add physical rule to pull projects from physical plan nodes, the rule is by default disabled
2. Run tests of CH backend with the rule enabled, to ensure rule is compatible with CH backend @zzcclp
3. Test Velox backend with the rule enabled
4. Enable the rule by default, and remove all the legacy pre/post project code
### C. Incremental optimizations to current code
1. Add Gluten project node when creating Gluten sort transformer
https://github.com/oap-project/gluten/pull/4497
## Related issues and PRs
1. An original issue
https://github.com/oap-project/gluten/issues/4213
2. A related discussion
https://github.com/oap-project/gluten/discussions/4308#discussioncomment-8036736
4. The original PRs
- https://github.com/oap-project/gluten/pull/3649
- https://github.com/oap-project/gluten/pull/4245
Contributor guide
Assessment
This issue has not been assessed yet.