matterport / matterport/Mask_RCNN

NMS for different classes

Open
#809 3 comments 5 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
25.6k
Forks
11.6k
PR merge metrics
No merged PRs in 30d

Description

Hi. I trained the model with my own dataset and it's working fine. During inference, some objects are filtered out because of low confidence. When I lower the DETECTION_MIN_CONFIDENCE parameter, the remaining objects are indeed detected, but sometimes overlapping bounding boxes/masks are located in the same object in the image. These overlapping masks are not filtered by NMS because they're from different classes (labels), i.e., the network is predicting the same object, with almost exactly the same mask, but assigning different labels to those predictions.

I was wondering if there is a way to apply NMS for different classes too (in my case, it is rare to find overlapping objects of different classes in the ground truth images).

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by locating the inference path that uses DETECTION_MIN_CONFIDENCE and applies NMS. Trace how class labels affect filtering, then determine how cross-class overlap should be handled without removing valid distinct objects. Done means overlapping predictions for different labels can be filtered according to the requested behavior, with coverage for this case.

Written by the indexing model from the issue text.

Assessment

Tech stack
keras, python, tensorflow
Domain
computer-vision
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.