apache / apache/lucene

How to support query cache in knn search

Open
#15,379 2 comments 0 reactions 0 assignees View on GitHub
type:enhancement
Dominant language
Java
Stars
3.6k
Forks
1.4k
Avg merge
2d 11h
Merged PRs (30d)
88

Description

### Description

Currently, knn search does not use LRUQueryCache for acceleration. The knn search is heavy when k is big.
Can query caching be supported in knn search?

In semantic search scenario, there are many hot queries. Query caching can speed up these queries.

Contributor guide

Open the contributing guide

Research direction

Start by tracing the knn search path and the existing LRUQueryCache integration. Determine whether repeated semantic-search queries can be cached safely, including the effect of large k values; done means supported hot queries use the cache without changing search results.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
backend, performance, search
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.