rccl wrappers
Open
Nobody has claimed this yet.
- Dominant language
- Julia
- Stars
- 344
- Forks
- 79
- Avg merge
- 2d 23h
- Merged PRs (30d)
- 27
Description
Similar to https://github.com/JuliaGPU/NCCL.jl/, it would be great to have wrappers for RCCL for training DL models on multiple AMDGPUs.
(I know MPI.jl has ROCm support but we don't ship JLLs that are rocm aware, so it might be good to ship RCCL_jll that automatically allows rocm aware communication without copying to CPU)
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reviewing the linked JuliaGPU/NCCL.jl implementation and the existing MPI.jl ROCm support. Define the RCCL wrappers and RCCL_jll packaging needed for ROCm-aware communication; done should enable multi-AMD-GPU deep-learning training without copying data to the CPU.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- julia
- Domain
- distributed-systems, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 30/100