facebookresearch / facebookresearch/segment-anything
Assistance with Syncing Coordinates in OpenSeaDragon for Point Prompting in SAM
- Dominant language
- Jupyter Notebook
- Stars
- 54.9k
- Forks
- 6.4k
- PR merge metrics
- No merged PRs in 30d
Description
**Description:**
I am currently working with the Segment Anything model and OpenSeaDragon for image segmentation tasks involving point prompts. I have successfully implemented the basic functionality, but I am encountering challenges when it comes to synchronizing the coordinates of the zoomed images in OpenSeaDragon with the input requirements of the SAM model.
Specifically, I am unsure of how to translate the viewport coordinates captured during user interaction in OpenSeaDragon to the image coordinates that the SAM model expects. This is crucial for encoding the point prompts correctly, as the model requires precise coordinates relative to the original image size.
Could anyone provide guidance or examples on how to handle the coordinate conversion and scaling when dealing with zoom levels and tiled images in OpenSeaDragon? Any advice or resources that could help me implement this functionality would be greatly appreciated.
Reference materials: https://openseadragon.github.io/
Contributor guide
Research direction
No repository file or test is named. Start with the OpenSeaDragon documentation and the SAM point-prompt requirements described in the issue; verify how viewport coordinates map to original image coordinates for zoomed or tiled images. Done means demonstrating a conversion that produces correctly scaled SAM point coordinates.
Written by the indexing model from the issue text.
Assessment
- Domain
- frontend, machine-learning
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100