deepseek-ai / deepseek-ai/DeepEP
Feature request: Enable multi-NIC RDMA support for GPU = 1:2 (CX8) systems in Hybrid-EP / GIN
Open
- Dominant language
- Cuda
- Stars
- 10.1k
- Forks
- 1.4k
- Avg merge
- 4d 1h
- Merged PRs (30d)
- 2
Description
On the hybrid-ep branch, on B300 systems equipped with CX8 NICs, where each GPU is connected to two RDMA NICs, inter-node communication during training appears to utilize only one NIC per GPU. As a result, the effective RDMA bandwidth per GPU does not scale with the available NIC resources, even though the hardware topology supports concurrent usage of multiple NICs. This behavior is consistently observed on B300 + CX8 platforms across training runs.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.