facebookresearch / facebookresearch/sam3

Can we do tensor-parallel or pipline-parallel infra with sam3?

Open
#481 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
11.7k
Forks
1.8k
PR merge metrics
No merged PRs in 30d

Description

Can we use tensor parallelism (TP) or pipeline parallelism (PP) techniques for SAM3 inference? Currently, SAM3's GPU memory consumption is very high during inference. For a 200M video, the memory usage reaches 50GB during propagation, and a 3000-frame video causes OOM (Out of Memory) on A100 80GB. Is multi-GPU parallelism feasible? How can we implement it?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.