facebookresearch / facebookresearch/segment-anything

[Extension Project] Generating Box Prompts with Zero-Shot Detector for Segment-Anything

Open
#74 4 comments 16 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
54.9k
Forks
6.4k
PR merge metrics
No merged PRs in 30d

Description

Hi! Thanks for releasing such impressive work! We find an interesting extension for this great work by combining **SoTA** zero-shot detector with Segment-Anything which can **generate high-quality box and mask annotations with text inputs**! The new project is here, we simply named it Grounded-Segment-Anything: https://github.com/IDEA-Research/Grounded-Segment-Anything

We take [Grounding-DINO](https://github.com/IDEA-Research/GroundingDINO) as the zero-shot detector to generate box prompts for segment-anything, and our visualization results are as follows:

![grounded_sam2](https://user-images.githubusercontent.com/48727989/230553209-350c8b6b-4015-4f87-b8a9-117f35271ca2.png)

We hope to maintain this project as a **sub-project** of segment-anything. We're also explore to combing Grouned-SAM with diffusion models for controllable image editing as well~

**More Examples**

![grounded_sam_demo3_demo4](https://user-images.githubusercontent.com/48727989/230617134-374fa587-b6d0-49d0-837c-271edabb2d7b.png)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.