lance-format / lance-format/lance
Filter flat_knn when scalar index is more caught up than vector index
Open
Nobody has claimed this yet.
A-index
enhancement
- Dominant language
- Rust
- Stars
- 7.1k
- Forks
- 852
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 272
Description
If the vector index is missing fragments then those fragments are run through a flat knn search. The scalar index may or may not include those fragments. Either way, we need to make sure we apply the prefilter to the flat knn data.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
The issue names no files or tests. Start by locating the flat_knn search path and how its prefilter is passed when vector-index fragments are missing; compare behavior when the scalar index includes those fragments. Done means the prefilter is applied to all flat knn data in both index-lag scenarios, with regression coverage for each case.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- rust
- Domain
- search
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 30/100