bytedance / bytedance/bolt

Support integration with Celeborn C++ client

Open
#13 6 comments 0 reactions 1 assignee Claimed by @zhangxffff View on GitHub
enhancement
Dominant language
C++
Stars
177
Forks
107
Avg merge
3d 10h
Merged PRs (30d)
49

Description

Celeborn is an intermediate data service for Big Data compute engines (i.e. ETL, OLAP and Streaming engines) to boost performance, stability, and flexibility. Intermediate data typically include shuffle and spilled data. Celeborn is widely used in Spark as a remote shuffle service, which is also used in bytedance. Therefore, Bolt would support integration with Celeborn C++ client to optimize native shuffle.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.