facebookresearch / facebookresearch/sam3

Inquire about the general training duration.

Open
#189 1 comment 2 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
11.7k
Forks
1.8k
PR merge metrics
No merged PRs in 30d

Description

Hi, I'm trying to fine-tune my data and I'm having some issues.

1. I added a "checkpoint_path" key under "trainer.model" in my YAML file and filled in the value: "path/to/sam3.pt". This is my first step in trying to fine-tune based on sam3. There were no errors, but there was no message in the logs indicating that it was loaded successfully. So is this the correct step?
2. On 8 B200 GPUs, the maximum batch size per GPU is set to 1. Increasing it to 2 causes an OutOfMemoryError (OOM), and the time per batch is 1.88s. Are these phenomena normal during training?

By the way, should line 143 of "roboflow_v100_full_ft_100_images.yaml" be corrected to "sam3.train.loss.loss_fns.SemanticSegCriterion"? It might be a minor bug.

Best

Contributor guide

Open the contributing guide

Research direction

Start by reading roboflow_v100_full_ft_100_images.yaml, especially line 143, and trace how trainer.model.checkpoint_path is handled during fine-tuning. Review the training logs and batch-size settings to establish what is expected; done means the checkpoint behavior, memory error, timing question, and possible class-reference issue are clearly resolved.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
machine-learning
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.