facebookresearch / facebookresearch/segment-anything

latency in set_image function

Open
#174 18 comments 6 reactions 0 assignees View on GitHub
question
Dominant language
Jupyter Notebook
Stars
54.9k
Forks
6.4k
PR merge metrics
No merged PRs in 30d

Description

Hi,

Thanks for the great sources. I can see the amazing performances.
When I implemented the code and tried to run the model, I could see that it takes long time at the 'set_image()' function.

I am just wondering if it is because of transformation functions is ImageEncoderViT method.
If so, is it supposed to take relatively long time?

for me, the elapsed time for each task was,
```
DINO model loading: 0.829
ViT encoder process: 17.912
SAM model prediction: 0.192
```

Thanks again,

Contributor guide

Open the contributing guide

Research direction

Start at set_image() and the ImageEncoderViT transformation functions named in the report, then reproduce the timing breakdown for DINO loading, ViT encoding, and SAM prediction. Done means determining whether the 17.912-second ViT encoder time is expected and documenting the relevant cause or next diagnostic.

Written by the indexing model from the issue text.

Assessment

Tech stack
jupyter-notebook
Domain
computer-vision, performance
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.