facebookresearch / facebookresearch/segment-anything

GPU memory for fine-tuning mask decoder only

Open
#664 3 comments 0 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
54.9k
Forks
6.4k
PR merge metrics
No merged PRs in 30d

Description

Hi, Thanks for the excellent work.

I will be fine tuning SAM mask-decoder only (keeping image and prompt encoder frozen) on few custom medical images. I have only 8GB of GPU memory available.

Do you think that this capacity is enough for fine-tuning mask decoder only. As in paper, it is mentioned that mask-decoder is very light weight. If not, is there any special setting that I can do to fix the tuning process within available memory?

Thanks!

Contributor guide

Open the contributing guide

Research direction

The issue does not name a file, test, or training entry point. Start with the repository's example notebooks and SAM model code, then determine whether mask-decoder-only fine-tuning and 8GB GPU guidance are documented. Done means providing verified memory guidance or settings for the described setup.

Written by the indexing model from the issue text.

Assessment

Tech stack
jupyter-notebook
Domain
computer-vision, machine-learning
Issue type
Documentation
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.