facebookresearch / facebookresearch/segment-anything

Automatic mask generator for area of interest

Open
#343 0 comments 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

Dominant language
Jupyter Notebook
Stars
54.9k
Forks
6.4k
PR merge metrics
No merged PRs in 30d

Description

Hi. I'm using AutomaticMaskGenerator for segment ct images. The model mostly failed to do that, due to the black background of the image, for example:

![abd-normal000003](https://github.com/facebookresearch/segment-anything/assets/49129250/f0335af5-42a8-4d5e-a8cf-66dd54f446e5)
I tried to use the points prompting, I've marked the black background with 0 labels, and the foreground of the ct image with label 1. But this method only returns 3 masks, and I need it to return every mask that it can.
Are there any ways to focus the AutomaticMaskGenerator on the foreground of the image to segment more masks?

another example of a liver ultrasound image:
![Figure_1](https://github.com/facebookresearch/segment-anything/assets/49129250/2c4a2916-d212-4d58-9188-26bda27c9b9d)

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start with AutomaticMaskGenerator and the points-prompting behavior described in the issue. Reproduce the CT and liver-ultrasound examples, then determine whether focusing on the foreground can produce all available masks; done means a documented or implemented approach that addresses the requested foreground and mask count.

Written by the indexing model from the issue text.

Assessment

Domain
computer-vision, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.