facebookresearch / facebookresearch/segment-anything

Satellite Imagery(tiny objects) Generalization

Open
#51 25 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
54.9k
Forks
6.4k
PR merge metrics
No merged PRs in 30d

Description

Thank you for the incredible work & congratulations!

SAM does not seem to generalize as well on satellite imagery(tiny objects). This was the result of the "**segment everything**" option on the image .
However SAM works better on the **same** image if I manually prompt the model to the object of interest (such as the tiny aircrafts on the LHS corner) that it may have missed in the "segment everything" option.
![Satellite Imagery](https://user-images.githubusercontent.com/68383273/230407968-24651c6d-fc6b-44f1-8f84-4b9d98e5cd69.png)

Couple of more examples with the "segment everything" option:

![image](https://user-images.githubusercontent.com/68383273/230461240-2e1fb684-fbab-4c16-868e-fe576cf960f3.png)

![image](https://user-images.githubusercontent.com/68383273/230461829-45e96469-c9d4-45a7-9736-7b7692b220da.png)

Any insights on the same would be most helpful !

Contributor guide

Open the contributing guide

Research direction

No specific file, test, or entry point is named. Start by reproducing the reported satellite-imagery behavior with the “segment everything” option, then compare it with manual prompts for the tiny aircraft. Done would require establishing whether the missed objects reflect a model limitation or an actionable defect and documenting the result.

Written by the indexing model from the issue text.

Assessment

Tech stack
jupyter-notebook
Domain
computer-vision, machine-learning
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.