facebookresearch / facebookresearch/moco

Multi-node

Open
#97 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
No language data
Stars
5.1k
Forks
802
PR merge metrics
No merged PRs in 30d

Description

Thanks for the great repo.
I notice that the readme file only give a suggestion on training on one node with 8 gpus.
So I wonder how does the code support for multi-nodes, such as:

# For node 0
python main_moco.py \
-a resnet50 \
--lr 0.03 \
--batch-size 256 \
--dist-url 'tcp://localhost:10001' --multiprocessing-distributed --world-size 2 --rank 0 \
[your imagenet-folder with train and val folders]

# For node 1
python main_moco.py \
-a resnet50 \
--lr 0.03 \
--batch-size 256 \
--dist-url 'tcp://localhost:10001' --multiprocessing-distributed --world-size 2 --rank 1 \
[your imagenet-folder with train and val folders]

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.