facebookresearch / facebookresearch/moco

About the batch size

Open
#111 2 comments 2 reactions 0 assignees View on GitHub
Dominant language
No language data
Stars
5.1k
Forks
802
PR merge metrics
No merged PRs in 30d

Description

Hi, thank you very much for sharing the code. I am doing some research using the MoCo model, and I am using this code in my experiments.

I would like to ask if it is possible to use a smaller mini-batch size (e.g. 32, which is smaller than the 256 in the MoCO paper)?

I like very much the fact that MoCo decouples the dictionary size from the mini-batch size. Does this mean that one could use a smaller batch size (while still keep the dictionary size large) without a substantial drop in the performance?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.