facebookresearch / facebookresearch/CutLER

Adapting CutLER for other detectors

Open
#65 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
1.1k
Forks
109
PR merge metrics
No merged PRs in 30d

Description

Hi, fantastic work on CutLER! From my understanding, CutLER is an approach to train a supervised detector, such as a Cascade Mask R-CNN, in an unsupervised manner using ViT, MaskCut, and DropLoss techniques. This implies that, theoretically, we should be able to replace the R-CNN detector with a single-stage detector like YOLO, provided we can modify the loss function accordingly.
I am planning to implement a few-shot learning approach by training a self-supervised model using the CutLER methodology on YOLOv8/YOLOv10, followed by fine-tuning on a specific dataset. Could you provide any suggestions on how to modify the YOLOv10 loss function to be compatible with the CutLER approach? Thank you!

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.