deepseek-ai / deepseek-ai/DeepEP

Feature request: Enable multi-NIC RDMA support for GPU = 1:2 (CX8) systems in Hybrid-EP / GIN

Open
#566 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Cuda
Stars
10.1k
Forks
1.4k
Avg merge
4d 1h
Merged PRs (30d)
2

Description

On the hybrid-ep branch, on B300 systems equipped with CX8 NICs, where each GPU is connected to two RDMA NICs, inter-node communication during training appears to utilize only one NIC per GPU. As a result, the effective RDMA bandwidth per GPU does not scale with the available NIC resources, even though the hardware topology supports concurrent usage of multiple NICs. This behavior is consistently observed on B300 + CX8 platforms across training runs.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.