Support integration with Celeborn C++ client
Open
enhancement
- Dominant language
- C++
- Stars
- 177
- Forks
- 107
- Avg merge
- 3d 10h
- Merged PRs (30d)
- 49
Description
Celeborn is an intermediate data service for Big Data compute engines (i.e. ETL, OLAP and Streaming engines) to boost performance, stability, and flexibility. Intermediate data typically include shuffle and spilled data. Celeborn is widely used in Spark as a remote shuffle service, which is also used in bytedance. Therefore, Bolt would support integration with Celeborn C++ client to optimize native shuffle.
Contributor guide
Assessment
This issue has not been assessed yet.