facebookresearch / facebookresearch/sam3

Segmentation Mask Scores

Open
#299 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
11.7k
Forks
1.8k
PR merge metrics
No merged PRs in 30d

Description

I want to get a score for each predicted mask in each frame. I found in the output of predictor.handle_stream_request, the field "out_probs" stays constant across frames. Is "out_probs" just the detection score for the first frame?
```
for response in predictor.handle_stream_request(request=dict(type="propagate_in_video", session_id=session_id)):
outputs = response["outputs"]
obj_score_logits = outputs["out_probs"] # stays the same across frames
...
```
Any suggestion of how to get the per-mask scores is appreciated.

Contributor guide

Open the contributing guide

Research direction

Start at predictor.handle_stream_request and the propagate_in_video response shown in the issue. Trace how outputs["out_probs"] is produced and whether it changes across frames, then inspect the surrounding inference outputs for a per-mask score. Done means clearly determining what out_probs represents and documenting or exposing the per-mask scores requested by the reporter.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
computer-vision, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.