Cache scanned folder files
Open
- Dominant language
- Python
- Stars
- 133k
- Forks
- 15.7k
- Avg merge
- 1d 10h
- Merged PRs (30d)
- 153
Description
Between calls to `/prompt` and when starting the program there is a lot of redundant work done in rescanning directories multiple times. This is the most significant slowdown I've encountered since I have thousands of models and each call to `object_info` can take up to half a minute per group of scans. And those scans are repeated many times since there is no caching, so that can make the call to `/object_info` time out
Contributor guide
Assessment
This issue has not been assessed yet.