facebookresearch / facebookresearch/sam2

Prompting with vague segmentation mask

Open
#327 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
19.9k
Forks
2.5k
PR merge metrics
No merged PRs in 30d

Description

Hi,

I tried prompting the model with a vague segmentation mask that I obtained from another model. The prompt isn’t very accurate, but it at least covers the object of interest. I expected SAM2 to refine the mask more precisely, but the results are not better.

Here is the mask prompt:
![image](https://github.com/user-attachments/assets/b828f3b7-6f0b-42d2-befd-35c4fcd1b62d)

And result from SAM:
![image](https://github.com/user-attachments/assets/4e5b9e4e-acc2-45c4-9a29-22b8a8d41d8a)

There are small patches scattered on the right side, and the left side of the mask is completely off.

What could be the reason? Does SAM2 always need a point/box to refine the masks?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.