facebookresearch / facebookresearch/SlowFast
Question about the config parameter BN.NUM_SYNC_DEVICES
Open
- Dominant language
- Python
- Stars
- 7.4k
- Forks
- 1.3k
- PR merge metrics
- No merged PRs in 30d
Description
I am confuse about this parameter BN.NUM_SYNC_DEVICES. Commonly I run my code on one machine with 8 cards and use sync_batchnorm as the bn layer, what value will be set for this parameter if I want sync the bn stats across all 8 cards? Should it set as 1 or 8?
Contributor guide
Assessment
This issue has not been assessed yet.