facebookresearch / facebookresearch/sam2

Segmentation Tuning possibilities

Open
#222 11 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
19.9k
Forks
2.5k
PR merge metrics
No merged PRs in 30d

Description

Hello, thanks for this very impressive tool!
Trying the large model out of the box on fish cell grayscale images I see that sometimes it segment a bit more than what a human would do, for example:
![Screenshot 2024-08-14 at 18 39 30](https://github.com/user-attachments/assets/f99e14ad-ea95-4699-b86e-6fbdffa34f6f)
![Screenshot 2024-08-14 at 18 38 21](https://github.com/user-attachments/assets/a1be820b-7764-40c7-95b6-33fa97d48b87)

and also there are disjoint regions for the same mask in some images for instance:
![Screenshot 2024-08-14 at 18 33 43](https://github.com/user-attachments/assets/14bc63bb-c2c2-4e26-9ee7-4905232bbb47)

what are the tuning possibilities? I see that `SAM2ImagePredictor` only has a few arguments, playing with max_sprinkle_area and max_hole_area does not seems to have much impact, while mask_threshold does. Any suggestions?
Thanks

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.