kvcache-ai / kvcache-ai/Mooncake
[Feature Request]: Support multiple pairs of NPUs for point-to-point transfer in transfer_engine_ascend_direct_perf.cpp
- Dominant language
- C++
- Stars
- 6.6k
- Forks
- 1.2k
- Avg merge
- 3d 5h
- Merged PRs (30d)
- 312
Description
### Describe your feature request
Hello,
I am currently using the example **transfer_engine_ascend_direct_perf.cpp** in the mooncake-transfer-engine project.
I noticed that this example currently **only supports single-pair NPU point-to-point data transfer** (one source NPU to one destination NPU).
I would like to ask:
Does the current transfer engine framework support **multiple pairs of NPUs transmitting point-to-point data** at the same time?
Is there a plan to support multi-pair NPU direct P2P transfer in this example?
If it is already supported, could you please provide a brief guide or sample code about how to implement it?
Thank you very much for your excellent work!
### Before submitting a new issue...
- [x] Make sure you already searched for relevant issues and read the [documentation](https://kvcache-ai.github.io/Mooncake/)
Contributor guide
Assessment
This issue has not been assessed yet.