facebookresearch / facebookresearch/moco
Multi-node
- Dominant language
- No language data
- Stars
- 5.1k
- Forks
- 802
- PR merge metrics
- No merged PRs in 30d
Description
Thanks for the great repo.
I notice that the readme file only give a suggestion on training on one node with 8 gpus.
So I wonder how does the code support for multi-nodes, such as:
# For node 0
python main_moco.py \
-a resnet50 \
--lr 0.03 \
--batch-size 256 \
--dist-url 'tcp://localhost:10001' --multiprocessing-distributed --world-size 2 --rank 0 \
[your imagenet-folder with train and val folders]
# For node 1
python main_moco.py \
-a resnet50 \
--lr 0.03 \
--batch-size 256 \
--dist-url 'tcp://localhost:10001' --multiprocessing-distributed --world-size 2 --rank 1 \
[your imagenet-folder with train and val folders]
Contributor guide
Assessment
This issue has not been assessed yet.