[VL] Gluten GPU support
- Dominant language
- Scala
- Stars
- 1.6k
- Forks
- 657
- Avg merge
- 2d 21h
- Merged PRs (30d)
- 85
Description
### Description
Velox GPU supports https://github.com/facebookincubator/velox/issues/12412, cooperated with Nvidia, merged the first PR, cuda docker image.
The second PR is to support orderby operator, https://github.com/facebookincubator/velox/pull/12735
We will enable it in gluten.
Firstly, support the basic operator.
Secondly, support TPCH.
Thirdly, support TPCDS.
There is still much work to do as showing in the slides.
[Gluten GPU backend.pptx](https://github.com/user-attachments/files/19391984/Gluten.GPU.backend.pptx)
[Gluten GPU on IBMTechXChange.pdf](https://github.com/user-attachments/files/22885881/Gluten.GPU.on.IBMTechXChange.pdf)
Contributor guide
Research direction
Start by reading Velox issue #12412 and PR #12735, then review the attached Gluten GPU backend slides and IBM TechXChange PDF. Map the basic-operator, TPCH, and TPCDS stages to Gluten before choosing a bounded piece of work; completion would mean the selected GPU stage is enabled and validated.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- scala, spark
- Domain
- backend, data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100