How to support query cache in knn search
Open
type:enhancement
- Dominant language
- Java
- Stars
- 3.6k
- Forks
- 1.4k
- Avg merge
- 2d 11h
- Merged PRs (30d)
- 88
Description
### Description
Currently, knn search does not use LRUQueryCache for acceleration. The knn search is heavy when k is big.
Can query caching be supported in knn search?
In semantic search scenario, there are many hot queries. Query caching can speed up these queries.
Contributor guide
Research direction
Start by tracing the knn search path and the existing LRUQueryCache integration. Determine whether repeated semantic-search queries can be cached safely, including the effect of large k values; done means supported hot queries use the cache without changing search results.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- backend, performance, search
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 30/100