facebookresearch / facebookresearch/segment-anything

A utility to export both SAM encoder and predictor to ONNX

Open
#809 2 comments 6 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
54.9k
Forks
6.4k
PR merge metrics
No merged PRs in 30d

Description

Hi,

At Kitware Europe, we are currently working on integrating SAM in [paraview/vtk](https://www.paraview.org/) as a new cpp plugin for smart and fast selection of point/cell data in a render view. To optimize the computing time, one can definitively cache the image embeddings if the image does not change, hence greatly reducing the annotation time if multiple clicks (only the mask encoding/decoding is called).
To achieve this, we developed internally a utility to export both the SAM encoder (image encoder) and predictor (prompt encoder/decoder + joint decoder) to ONNX.
We thought it could be usefull to the community as well:
https://gitlab.kitware.com/keu-computervision/ml/sam-onnx-exporter

Thanks to @iel-amra who worked on this,

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.