facebookresearch / facebookresearch/moco

Difference between the encoder_q and the encoder_k.

Open
#63 1 comment 2 reactions 0 assignees View on GitHub
Dominant language
No language data
Stars
5.1k
Forks
802
PR merge metrics
No merged PRs in 30d

Description

Dear author:
The momentum update strategy ensures the consistency of query encoder at each step, but it leads to the difference between the query encoder and the key encoder. Why the consistence of encoder_q at each step is more important than the consistence between encoder_q and encoder_k?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.