lllyasviel / lllyasviel/FramePack

Windows Titan RTX issue

Open
#79 2 comments 1 reaction 0 assignees View on GitHub
Dominant language
Python
Stars
17.3k
Forks
1.7k
PR merge metrics
No merged PRs in 30d

Description

I have a Titan RTX with 24GB VRAM, however I keep running into this:

torch.OutOfMemoryError: CUDA out of memory. Tried to allocate 28.86 GiB. GPU 0 has a total capacity of 24.00 GiB of which 3.80 GiB is free. Of the allocated memory 18.56 GiB is allocated by PyTorch, and 395.50 MiB is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True to avoid fragmentation. See documentation for Memory Management (https://pytorch.org/docs/stable/notes/cuda.html#environment-variables)

Does this not with with the Titan RTX?

Contributor guide

No contributing guide indexed for this repository

Research direction

No source file or test is named. Start by reproducing the reported PyTorch CUDA out-of-memory error on a Titan RTX and tracing the FramePack entry point that allocates GPU memory; compare the requested allocation with the model's expected requirements. Done means determining whether the hardware is supported and documenting or fixing the confirmed cause.

Written by the indexing model from the issue text.

Assessment

Tech stack
python, pytorch
Domain
machine-learning, performance
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.