facebookresearch / facebookresearch/sam3
Segmentation Mask Scores
- Dominant language
- Python
- Stars
- 11.7k
- Forks
- 1.8k
- PR merge metrics
- No merged PRs in 30d
Description
I want to get a score for each predicted mask in each frame. I found in the output of predictor.handle_stream_request, the field "out_probs" stays constant across frames. Is "out_probs" just the detection score for the first frame?
```
for response in predictor.handle_stream_request(request=dict(type="propagate_in_video", session_id=session_id)):
outputs = response["outputs"]
obj_score_logits = outputs["out_probs"] # stays the same across frames
...
```
Any suggestion of how to get the per-mask scores is appreciated.
Contributor guide
Research direction
Start at predictor.handle_stream_request and the propagate_in_video response shown in the issue. Trace how outputs["out_probs"] is produced and whether it changes across frames, then inspect the surrounding inference outputs for a per-mask score. Done means clearly determining what out_probs represents and documenting or exposing the per-mask scores requested by the reporter.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- computer-vision, machine-learning
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 45/100