facebookresearch / facebookresearch/sam2

Fine-tuning SAM 2 to Output Segmentation Masks with Class Names

Open
#326 3 comments 4 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
19.9k
Forks
2.5k
PR merge metrics
No merged PRs in 30d

Description

I am working on a project that involves using SAM 2 for image segmentation, and I would like to explore the possibility of fine-tuning the model to output segmentation masks along with their corresponding class names. The goal is to not only obtain the segmentation masks but also associate each segmented object with its respective class name.

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the repository's inference code and example notebooks to understand how SAM 2 currently produces segmentation masks. Determine what fine-tuning workflow is needed and how class names would be represented alongside each mask; done means a documented approach or working example that produces both outputs.

Written by the indexing model from the issue text.

Assessment

Tech stack
jupyter-notebook
Domain
computer-vision, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.