Make torchrun options ( --nnodes, --nproc-per-node, etc.) same a mpirun/mpiexec
Open
bot-triaged
feature
module: elastic
oncall: distributed
oncall: distributed infra
ptd-bot-triaged
- Dominant language
- Python
- Stars
- 103k
- Forks
- 29.5k
- PR merge metrics
- PR metrics pending
Description
### 🚀 The feature, motivation and pitch
Make the common options similar to mpirun/mpiexec ( e.g. -n - ppn )
### Alternatives
_No response_
### Additional context
_No response_
cc @awgu @wanchaol @fegin @fduwjj @wz337 @wconstab @d4l3k @pragupta @msaroufim @dcci @aditvenk @weifengpy @dzhulgakov @xmfan
Contributor guide
Assessment
This issue has not been assessed yet.