[VL] Update Velox Backend GA: Migrate Special Scenarios to Spark 3.4
Open
enhancement
- Dominant language
- Scala
- Stars
- 1.6k
- Forks
- 657
- Avg merge
- 2d 14h
- Merged PRs (30d)
- 80
Description
### Description
Upon upgrading the Celeborn version, I noticed that our tests for specific scenarios—such as out-of-memory (OOM) conditions, random terminations, and remote shuffle services (RSS) like Celeborn and Uniffle—are still conducted using Spark 3.2. Given that our current default Spark version is 3.4, it would be prudent to align these special scenario tests with Spark 3.4.
Contributor guide
Assessment
This issue has not been assessed yet.