facebookresearch / facebookresearch/sam3

Fine-tuning issue

Open
#306 0 comments 4 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
11.7k
Forks
1.8k
PR merge metrics
No merged PRs in 30d

Description

Hello,

Thank you for the great work! I just had a question:

The datasets provided for fine-tuning do not have segmentation masks, rather, they have bounding boxes (as I understand), so, how to fine-tune the model using segmentation masks with corresponding text prompt on a custom dataset?

Best,
Mohamed

Contributor guide

Open the contributing guide

Research direction

Start with the fine-tuning example notebooks described in the repository, and compare their expected bounding-box annotations with a custom dataset containing segmentation masks and text prompts. Trace the fine-tuning entry point to determine whether this annotation format is supported, then establish the required workflow or missing capability.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
computer-vision, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.