facebookresearch / facebookresearch/sam3

Question about Real Time Video Segmentation Performance Benchmark

Open
#155 1 comment 11 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
11.7k
Forks
1.8k
PR merge metrics
No merged PRs in 30d

Description

Hi Team,

want to know how to evaluate the real time performance of sam3 model predictor over video?
Any scripts or notebook support fps benchmark?

In the paper, here are some related inforamtion:

> To support real-time inference (30 FPS) on videos in practical applications (e.g., a web demo), we parallelize the inference over multiple GPUs: up to 10 objects on 2 H200s, up to 28 objects on 4 H200s, and up to 64 objects on 8 H200s.

Also in Table 7:
Image

> In video, the inference latency scales with the number of objects, sustaining near real-time performance for ∼ 5 concurrent objects.

Want to know details about how to `test` this benchmark. Any concise benchmark script or a short decision matrix showing expected fps vs. GPU class and tracked object count (with conservative estimated bands).

Thank you

Contributor guide

Open the contributing guide

Research direction

Start with the repository's example notebooks and the SAM 3 video predictor entry point, then determine how inference latency and FPS should be measured across tracked object counts and GPU configurations. Done means documenting a reproducible benchmark procedure, or adding the concise benchmark script or decision matrix requested in the issue.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
computer-vision, machine-learning
Issue type
Documentation
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.