facebookresearch / facebookresearch/detectron2

Compatibility of demo code with the new baselines for Instance Segmentation with Mask R-CNN

Open
#3,416 8 comments 2 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
34.7k
Forks
7.9k
PR merge metrics
No merged PRs in 30d

Description

## 🚀 Feature
Adding the support for the new baseline instance segmentation models introduced in [Model Zoo ](https://github.com/facebookresearch/detectron2/blob/master/MODEL_ZOO.md) for the `demo.py`. Currently the code is written so that it only supports checkpoints with `.yaml` configs and models with Yacs Config . I have been able to load the checkpoints using [Lazyconfigs](https://detectron2.readthedocs.io/en/latest/tutorials/lazyconfigs.html) instructions, however, I have not been able to populate the detector model with the loaded weights.

I am using detectron2 as an off the shelf object detector in the system I am designing. Therefore, I am not doing any training for the object detector and it would be very nice if I can easily use your demo code with the new baseline models.

Contributor guide

Open the contributing guide

Research direction

Start in demo.py and compare its existing YAML/Yacs checkpoint path with the LazyConfig loading instructions linked in the issue. Trace how the loaded checkpoint is expected to populate the detector model, then verify that the new Model Zoo instance-segmentation baselines can run through the demo code with their weights loaded.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
computer-vision, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
28/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.