lightly-ai / lightly-ai/lightly
EMP-SSL
@johnsutor is already working on this.
Since Dec 18, 2023.
- Dominant language
- Python
- Stars
- 3.8k
- Forks
- 367
- Avg merge
- 3d 22h
- Merged PRs (30d)
- 5
Description
Hi Team,
I recently came across this paper (Link: [EMP-SSL Paper](https://arxiv.org/abs/2304.03977)). The authors have provided their implementation on Github [(EMP-SSL Repository)](https://github.com/tsb0601/EMP-SSL).
TLDR of the method: The key towards efficient self-supervised learning is to increase the number of crops from each image instance.
Key contributions:
- EMP-SSL can reduce the training epochs by two orders of magnitude.
- The method seems to transfer well to out-of-domain tasks.
- Due to the reduction in training epochs, the overall training time is considerably decreased. This, however, may come at the cost of increased memory usage.
Considering the promising results this method has shown, I think it could be a valuable addition to the collection of self-supervised learning methods so that it is accessible to the larger community.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.