facebookresearch / facebookresearch/segment-anything

Detail about the 11 iteration during training

Open
#689 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
54.9k
Forks
6.4k
PR merge metrics
No merged PRs in 30d

Description

During the training process, each batch of image embeddings will be iteratively input to the mask decoder 11 times, and the mask decoder will output mask logits 11 times. I wonder if the mask logits of each output need to be used to calculate the loss, or is it just the last prediction to get the mask logits to calculate the loss?

Contributor guide

Open the contributing guide

Research direction

The issue does not name a file, test, or entry point. Trace the training process from the mask decoder call and inspect how the 11 mask-logit outputs are consumed, then document whether every iteration or only the final prediction contributes to the loss.

Written by the indexing model from the issue text.

Assessment

Domain
computer-vision, machine-learning
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.