facebookresearch / facebookresearch/sam2
Fine-tuning SAM 2 to Output Segmentation Masks with Class Names
- Dominant language
- Jupyter Notebook
- Stars
- 19.9k
- Forks
- 2.5k
- PR merge metrics
- No merged PRs in 30d
Description
I am working on a project that involves using SAM 2 for image segmentation, and I would like to explore the possibility of fine-tuning the model to output segmentation masks along with their corresponding class names. The goal is to not only obtain the segmentation masks but also associate each segmented object with its respective class name.
Contributor guide
Research direction
Start by reviewing the repository's inference code and example notebooks to understand how SAM 2 currently produces segmentation masks. Determine what fine-tuning workflow is needed and how class names would be represented alongside each mask; done means a documented approach or working example that produces both outputs.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- jupyter-notebook
- Domain
- computer-vision, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100