facebookresearch / facebookresearch/detectron2

How can you use a Transformer model as a backbone? No documentation available

Open
#4,505 3 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
34.7k
Forks
7.9k
PR merge metrics
No merged PRs in 30d

Description

Hey,
Just wanted to know that how could you use a pre-trained Transformer model for object detection? I want to use [Microsoft's DiT](https://github.com/microsoft/unilm/tree/master/dit/object_detection). Seems like they have used it with `Detectron2` but no clear steps have been described. Can you please let me know about where can I find the blog / tutorial / documentation on how to fine tune that transformer architecture to use it as a detection backbone with `Faster RCNN` / `Cascade RCNN`.

Thanks in advance :)

Contributor guide

Open the contributing guide

Research direction

Start with Microsoft's DiT object_detection example and the existing Detectron2 documentation. Determine and document the steps for fine-tuning the Transformer architecture as a detection backbone with Faster R-CNN and Cascade R-CNN; done means a newcomer can follow the guide without needing undocumented setup knowledge.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
computer-vision, documentation
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.