deepseek-ai / deepseek-ai/DeepEP

Zero-copy intranode for EPv2

Open
#655 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Cuda
Stars
10.1k
Forks
1.4k
Avg merge
4d 1h
Merged PRs (30d)
2

Description

EPv1's `low_latency_combine` supports `zero_copy` ([#79](https://github.com/deepseek-ai/DeepEP/pull/79)), but EPv2's `ElasticBuffer` does not — `recv_x` is always freshly allocated and a full-SM copy epilogue always runs:

https://github.com/deepseek-ai/DeepEP/blob/b306af06afd412c88e51e71802951606e40b7358/csrc/elastic/buffer.hpp#L1013

For intranode NVLink-only workloads, this epilogue takes 10% of total time. Would it be possible to support a zero-copy mode for EPv2's intranode path — either by returning a view into the symmetric buffer directly, or by fusing the scatter into the dispatch kernel?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.