kvcache-ai / kvcache-ai/Mooncake

[Feature Request]: Support multiple pairs of NPUs for point-to-point transfer in transfer_engine_ascend_direct_perf.cpp

Open
#2,096 1 comment 0 reactions 1 assignee Claimed by @ascend-direct-dev View on GitHub
Dominant language
C++
Stars
6.6k
Forks
1.2k
Avg merge
3d 5h
Merged PRs (30d)
312

Description

### Describe your feature request

Hello,
I am currently using the example **transfer_engine_ascend_direct_perf.cpp** in the mooncake-transfer-engine project.
I noticed that this example currently **only supports single-pair NPU point-to-point data transfer** (one source NPU to one destination NPU).
I would like to ask:
Does the current transfer engine framework support **multiple pairs of NPUs transmitting point-to-point data** at the same time?
Is there a plan to support multi-pair NPU direct P2P transfer in this example?
If it is already supported, could you please provide a brief guide or sample code about how to implement it?
Thank you very much for your excellent work!

### Before submitting a new issue...

- [x] Make sure you already searched for relevant issues and read the [documentation](https://kvcache-ai.github.io/Mooncake/)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.