deepseek-ai / deepseek-ai/DeepEP

question about Hybrid-EP

Open
#567 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Cuda
Stars
10.1k
Forks
1.4k
Avg merge
4d 1h
Merged PRs (30d)
2

Description

hello~@Autumn1998 I’d like to ask some questions about Hybrid-EP.

1. i found that there has cudamemcpy from/to user hidden tensor to/from rdma registed buffer in Hybrid-EP. When using the permute version, the cudamemcpy in postprocess can be fused, but the preprocessing still remains. So i wonder if it can use zero copy in Hybrid-EP like [this]( https://github.com/deepseek-ai/DeepEP/pull/79/files).
2. There seem to be redundant stores [here](https://github.com/deepseek-ai/DeepEP/blob/hybrid-ep/csrc/hybrid_ep/extension/permute.cu#L202).
thx~

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.