[VL] umbrella performance issues during Gluten adoption
Open
adoption
enhancement
tracker
- Dominant language
- Scala
- Stars
- 1.6k
- Forks
- 657
- Avg merge
- 2d 14h
- Merged PRs (30d)
- 80
Description
### Description
- [ ] task killed by yarn, #6947
- [ ] global memory OOM, #7249
- [ ] bad spill performance #7159
- [ ] bad R2C performance #7223
- [ ] bad BHJ performance when broadcast table is large
- [ ] UDF
- [ ] object hashagg
Contributor guide
Research direction
This is an umbrella issue covering task-kill, global-memory OOM, spill, R2C, large-broadcast BHJ, UDF, and object-hashagg performance concerns. Start by reading linked issues #6947, #7249, #7159, and #7223, then investigate the remaining checklist items in their relevant Gluten and Spark execution paths. Done requires the individual performance issues to be resolved or separately tracked with clear results.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- scala, spark
- Domain
- data-engineering, performance
- Issue type
- Bug
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 15/100