VRAM Doesn't unload after a work session (set unload delay to 5m?)
Open
- Dominant language
- Python
- Stars
- 133k
- Forks
- 15.7k
- Avg merge
- 1d 10h
- Merged PRs (30d)
- 153
Description
Hello There,
As many of us may use several IA tools it is very important to free VRAM when not in use so that the model could still be loaded from RAM quickly without having to sit on VRAM.
Is there an option to use ?
Contributor guide
Assessment
This issue has not been assessed yet.