facebookresearch / facebookresearch/detectron2

LVIS Models not working for Instance Segmentation

Open
#4,942 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
34.7k
Forks
7.9k
PR merge metrics
No merged PRs in 30d

Description

I am using the following command to create a **LVISv0.5 Instance Segmentation video** using the LVISv0.5 configs:

`python demo.py --config-file ../configs/LVISv0.5-InstanceSegmentation/mask_rcnn_X_101_32x8d_FPN_1x.yaml --video-input vid1.mp4 --output LVISv05-InstanceSegmentation_mask_rcnn_X_101_32x8d_FPN_1x.mp4`

Now this is not performing any type of segmentation in the output video, whereas when I use **COCO Instance Segmentation on the same video, it works**. The COCO commands is as follows:

`python demo.py --config-file ../configs/COCO-InstanceSegmentation/mask_rcnn_R_50_FPN_3x.yaml --video-input vid2.mp4 --output COCO-InstanceSegmentation_mask_rcnn_R_50_FPN_3x.mp4 --opts MODEL.WEIGHTS detectron2://COCO-InstanceSegmentation/mask_rcnn_R_50_FPN_3x/137849600/model_final_f10217.pkl`

This is the input video link for your reference:
https://drive.google.com/file/d/1iLqNdLBGUryIl4lAot1YpZOU6s76FUgI/view?usp=share_link

Am I missing something?

Contributor guide

Open the contributing guide

Research direction

Start with demo.py and compare the LVISv0.5 and COCO configuration paths shown in the commands, including how model weights are selected. Reproduce the video inference, then verify whether the LVIS run loads the intended weights and produces instance masks; the issue is resolved when LVIS segmentation appears in the output video.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
computer-vision, machine-learning
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.