Model not unloaded into CPU memory
Open
- Dominant language
- Python
- Stars
- 133k
- Forks
- 15.7k
- Avg merge
- 1d 7h
- Merged PRs (30d)
- 158
Description
I think the --highvram option always works in the latest environment.
Even after generation, GPU memory is still allocated and not unloaded.
Contributor guide
Assessment
This issue has not been assessed yet.