deepseek-ai / deepseek-ai/DeepEP
question about Hybrid-EP
Open
- Dominant language
- Cuda
- Stars
- 10.1k
- Forks
- 1.4k
- Avg merge
- 4d 1h
- Merged PRs (30d)
- 2
Description
hello~@Autumn1998 I’d like to ask some questions about Hybrid-EP.
1. i found that there has cudamemcpy from/to user hidden tensor to/from rdma registed buffer in Hybrid-EP. When using the permute version, the cudamemcpy in postprocess can be fused, but the preprocessing still remains. So i wonder if it can use zero copy in Hybrid-EP like [this]( https://github.com/deepseek-ai/DeepEP/pull/79/files).
2. There seem to be redundant stores [here](https://github.com/deepseek-ai/DeepEP/blob/hybrid-ep/csrc/hybrid_ep/extension/permute.cu#L202).
thx~
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.