facebookresearch / facebookresearch/segment-anything

How to reduce GPU usage ?

Open
#351 2 comments 15 reactions 0 assignees View on GitHub
Dominant language
Jupyter Notebook
Stars
54.9k
Forks
6.4k
PR merge metrics
No merged PRs in 30d

Description

GPU 1050Ti with 4G memory, got this error.

```
RuntimeError: CUDA out of memory. Tried to allocate 768.00 MiB (GPU 0; 4.00 GiB total capacity; 2.71 GiB already allocated; 0 bytes free; 2.81 GiB reserved in total by PyTorch)
```

Contributor guide

Open the contributing guide

Research direction

The report names no file, test, or entry point, only a PyTorch CUDA out-of-memory error on a 4 GB GPU. Start by locating the inference example or notebook that produces the allocation, then establish a reproducible lower-memory configuration and verify that inference completes without the reported error.

Written by the indexing model from the issue text.

Assessment

Tech stack
pytorch
Domain
machine-learning, performance
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.