apache / apache/gluten

[VL] Umbrella issue for sort-based shuffle

Open
#6,896 1 comment 9 reactions 0 assignees View on GitHub
enhancement shuffle tracker
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

### Description

- Initial patch: https://github.com/apache/incubator-gluten/pull/6475 (TPCDS SF3T 40000 partitions **1.13x** vs hash)
- follow up: https://github.com/apache/incubator-gluten/pull/6579
- follow up: https://github.com/apache/incubator-gluten/pull/6628
- [Performance] https://github.com/apache/incubator-gluten/pull/6639 **(1.25x)**
- [Performance] https://github.com/apache/incubator-gluten/pull/6727 **(1.3x)**
- [Performance] https://github.com/apache/incubator-gluten/pull/6782 **(1.33x)** (Pending on Velox PR)
- [UI] https://github.com/apache/incubator-gluten/pull/6799
- [Bug fix #6822] https://github.com/apache/incubator-gluten/pull/6832
- [Bug fix #6863] https://github.com/apache/incubator-gluten/pull/6869
- [Performance] https://github.com/apache/incubator-gluten/pull/7897

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.