facebookresearch / facebookresearch/segment-anything

predictor with text prompt using CLIP

Open
#6 18 comments 14 reactions 0 assignees View on GitHub
how-to
Dominant language
Jupyter Notebook
Stars
54.9k
Forks
6.4k
PR merge metrics
No merged PRs in 30d

Description

Hi,

I have implemented text prompt-controlled segmentation using selective search and CLIP. Can you suggest any additional techniques I can include? I am considering trying CLIP-GradCAM #4

https://github.com/Usama3059/SAMtext/blob/main/notebooks/SAM%20_predictor_with_text-prompt_using_CLIP_v1.ipynb

Text prompt: the car side mirror

CLIP suggestion:
![sam1](https://user-images.githubusercontent.com/43669817/230163776-1798e693-a4e8-4ecc-be51-9a7823a780b1.png)

SAM segmentation
![sam2](https://user-images.githubusercontent.com/43669817/230163870-d8fbddbb-4be5-434d-a923-58754f482df8.png)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.