facebookresearch / facebookresearch/sam2
[Project] Grounded SAM 2 Release
- Dominant language
- Jupyter Notebook
- Stars
- 19.9k
- Forks
- 2.5k
- PR merge metrics
- No merged PRs in 30d
Description
We combine Grounding DINO, Grounding DINO 1.5 and SAM 2 for tracking any object in the input video and we've open-sourced our code here: [Grounded SAM 2](https://github.com/IDEA-Research/Grounded-SAM-2)
In this repo, we've supported:
- Segment Anything based on Grounding DINO, Grounding DINO 1.5 box predictor
- Track Anything based on Grounding DINO and SAM 2 video predictor
- We've **implemented the code as simply as possible** (less than 150 lines of code), and we hope it can bring more convenience to the community.
- We've noticed that the SAM 2 video predictor does not support box prompts now, so we've implement a **simple uniformly positive point prompts sampling method** based on the SAM 2 image predictor to support box prompts in video tracking demo, refer to our code for more details
We will update our code in the future release to support more demos for better usage.
A simple tracking video demo is as follows:
https://github.com/user-attachments/assets/8ebfa5de-3eac-43c5-b8e2-49160c9df786
Contributor guide
Assessment
This issue has not been assessed yet.