jd-opensource / jd-opensource/JoyAI-Echo

CUDA out of memory

Open
#4 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
2k
Forks
168
Avg merge
2h 58m
Merged PRs (30d)
1

Description

HW: GPU0 & GPU1

Error:
torch.OutOfMemoryError: CUDA out of memory. Tried to allocate 114.00 MiB. GPU 0 has a total capacity of 15.58 GiB of which 45.25 MiB is free. Including non-PyTorch memory, this process has 15.51 GiB memory in use. Of the allocated memory 15.38 GiB is allocated by PyTorch, and 9.48 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True to avoid fragmentation.

Q: How to make it run with two RTX-GPUs ?

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.