deepspeedai / deepspeedai/DeepSpeed
[REQUEST] Support for compile without NCCL dependency
Nobody has claimed this yet.
- Dominant language
- Python
- Stars
- 43.1k
- Forks
- 5k
- Avg merge
- 4d 15h
- Merged PRs (30d)
- 112
Description
Is your feature request related to a problem? Please describe.
On my hardware platform Jeton Agx Orin, the system does not support NCCL libraries。So i can not compile Deepspeed on my device
Describe the solution you'd like
Deepspeed support compilation without NCCL, and also give the alternative parameter just like pytorch setup.py, I can set
export USE_NCCL=0
export USE_MPI=1
Describe alternatives you've considered
Additional context
My environment:
- OS: Ubuntu 22.04
- GPU :Jetson AGX Orin
- CPU: ARM64v8
- Python :3.10.12
- CUDA:11.6
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The request is for a DeepSpeed build path that does not require NCCL and for USE_NCCL=0/USE_MPI=1-style options. Start by reviewing DeepSpeed's build configuration and the PyTorch setup.py behavior referenced in the report. Done means an ARM64 Jetson build succeeds without NCCL and the alternative configuration is documented and tested.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python, pytorch
- Domain
- distributed-systems, machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100