facebookresearch / facebookresearch/segment-anything

Use precomputed embeddings for SamAutomaticMaskGenerator

Open
#401 0 comments 1 reaction 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
54.9k
Forks
6.4k
PR merge metrics
No merged PRs in 30d

Description

Is it possible to precompute the embeddings, similarly to predictor.set_image(), for the SamAutomaticMaskGenerator.generate() function?

This would be useful for quicker runs on a CPU machine after having precomputed the embeddings on a GPU.

Contributor guide

Open the contributing guide

Research direction

Start with the SamAutomaticMaskGenerator.generate() and predictor.set_image() entry points named in the issue, comparing how image embeddings are prepared and consumed. Done means the generator can use embeddings precomputed on GPU for quicker CPU runs, with behavior matching normal generation.

Written by the indexing model from the issue text.

Assessment

Domain
computer-vision, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.