facebookresearch / facebookresearch/sam3
BUG? Bbox prompt does not work with prompted text "visual"?
- Dominant language
- Python
- Stars
- 11.7k
- Forks
- 1.8k
- PR merge metrics
- No merged PRs in 30d
Description
I prompted SAM 3 model in the first frame with the bounding box of the person and the prompted text was set to the default option "visual". However, the model did not produce output for the rest of the frames, except the first one, saying "no objects detected".
response = predictor.handle_request(
request=dict(
type="add_prompt",
session_id=session_id,
frame_index=0,
text="visual",
bounding_boxes = box_abs_to_rel_coords(H, W, 382, 163, 486, 324),
bounding_box_labels = [1]
)
)
outputs_per_frame = propagate_in_video(predictor, session_id) # this did not find any object
What is the issue?
Is it the fact that the text prompt should always be consistent with the bbox? But, in this case, why would you have an available option "visual" for the cases of only the box prompts?




Contributor guide
Research direction
Start by reproducing the request using the shown add_prompt call with text="visual" and the bounding box, then run propagate_in_video for the session. Read the prompt-handling and propagation entry points involved in these calls and compare the first-frame result with later-frame detection. Done means the prompted person is detected and propagated across the remaining frames, or the incompatibility is clearly documented.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- python
- Domain
- computer-vision, machine-learning
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 45/100