facebookresearch / facebookresearch/segment-anything

Assistance with Syncing Coordinates in OpenSeaDragon for Point Prompting in SAM

Open
#686 1 comment 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
54.9k
Forks
6.4k
PR merge metrics
No merged PRs in 30d

Description

**Description:**

I am currently working with the Segment Anything model and OpenSeaDragon for image segmentation tasks involving point prompts. I have successfully implemented the basic functionality, but I am encountering challenges when it comes to synchronizing the coordinates of the zoomed images in OpenSeaDragon with the input requirements of the SAM model.

Specifically, I am unsure of how to translate the viewport coordinates captured during user interaction in OpenSeaDragon to the image coordinates that the SAM model expects. This is crucial for encoding the point prompts correctly, as the model requires precise coordinates relative to the original image size.

Could anyone provide guidance or examples on how to handle the coordinate conversion and scaling when dealing with zoom levels and tiled images in OpenSeaDragon? Any advice or resources that could help me implement this functionality would be greatly appreciated.

Reference materials: https://openseadragon.github.io/

Contributor guide

Open the contributing guide

Research direction

No repository file or test is named. Start with the OpenSeaDragon documentation and the SAM point-prompt requirements described in the issue; verify how viewport coordinates map to original image coordinates for zoomed or tiled images. Done means demonstrating a conversion that produces correctly scaled SAM point coordinates.

Written by the indexing model from the issue text.

Assessment

Domain
frontend, machine-learning
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.