facebookresearch / facebookresearch/sam2

[Project] Grounded SAM 2 Release

Open
#130 3 comments 7 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
19.9k
Forks
2.5k
PR merge metrics
No merged PRs in 30d

Description

We combine Grounding DINO, Grounding DINO 1.5 and SAM 2 for tracking any object in the input video and we've open-sourced our code here: [Grounded SAM 2](https://github.com/IDEA-Research/Grounded-SAM-2)

In this repo, we've supported:
- Segment Anything based on Grounding DINO, Grounding DINO 1.5 box predictor
- Track Anything based on Grounding DINO and SAM 2 video predictor
- We've **implemented the code as simply as possible** (less than 150 lines of code), and we hope it can bring more convenience to the community.
- We've noticed that the SAM 2 video predictor does not support box prompts now, so we've implement a **simple uniformly positive point prompts sampling method** based on the SAM 2 image predictor to support box prompts in video tracking demo, refer to our code for more details

We will update our code in the future release to support more demos for better usage.

A simple tracking video demo is as follows:

https://github.com/user-attachments/assets/8ebfa5de-3eac-43c5-b8e2-49160c9df786

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.