How can I accelerate the speed of switching different models?
Open
User Support
- Dominant language
- Python
- Stars
- 133k
- Forks
- 15.7k
- Avg merge
- 1d 7h
- Merged PRs (30d)
- 158
Description
When I need to change the model, I want it to be faster.
How can I achieve this?
such as:load the 3 models in common use into VRAM all at once
Where can I modify it?
thanks
Contributor guide
Assessment
This issue has not been assessed yet.