meta-pytorch / meta-pytorch/torchcomms
Question: about CTran Send Recv
Nobody has claimed this yet.
- Dominant language
- C++
- Stars
- 396
- Forks
- 190
- PR merge metrics
- No merged PRs in 30d
Description
Hi, Thank you for your nice work! I have read about your paper Collective Communication for 100k+ GPUs especially Chapter 5.1 PP: Zero-copy and SM-free Send/Receive.
I wander how to use CTran to achieve SM-free and Zero Copy send recv in async way, without using NCCL copy-based send/recv or RDMA which would rely on pre-allocate buffer, or maybe register user tensor as RDMA MR every time when we launch send/recv? Is there a best practice?
In the evaluation chapter of your paper Collective Communication for 100k+ GPUs, you have mention SM-Free and Zero Copy send recv. So I really really want to try it :)
Also I notice send recv in ncclx backend still using nccl, which is not SM Free and Zero Copy, I wander why we don't use Ctran to implement a better version that is SM Free and Zero Copy?
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names CTran and the ncclx backend but does not identify a source file or test. Read the CTran and ncclx send/recv entry points and Chapter 5.1 of the linked paper first; define the supported async, SM-free, zero-copy behavior and a reproducible validation path before proposing implementation.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- cpp
- Domain
- distributed-systems
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100