apache / apache/gluten

[VL] Update Velox Backend GA: Migrate Special Scenarios to Spark 3.4

Open
#9,013 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Scala
Stars
1.6k
Forks
657
Avg merge
2d 14h
Merged PRs (30d)
80

Description

### Description

Upon upgrading the Celeborn version, I noticed that our tests for specific scenarios—such as out-of-memory (OOM) conditions, random terminations, and remote shuffle services (RSS) like Celeborn and Uniffle—are still conducted using Spark 3.2. Given that our current default Spark version is 3.4, it would be prudent to align these special scenario tests with Spark 3.4.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.