Add bulk off-heap scoring for vector formats
Open
type:enhancement
vector-based-search
- Dominant language
- Java
- Stars
- 3.6k
- Forks
- 1.4k
- Avg merge
- 2d 11h
- Merged PRs (30d)
- 88
Description
### Description
We found some pretty awesome latency improvements with float32 vectors bulk scoring off-heap. It makes me think we can get nice improvements for byte vectors and all the quantized formats.
See: https://github.com/apache/lucene/pull/14980
&: https://github.com/apache/lucene/pull/14978
Contributor guide
Research direction
Start by reviewing the linked PRs 14980 and 14978 to understand the existing float32 off-heap bulk-scoring work and its entry points. Trace how that approach applies to byte vectors and the quantized formats, then verify that those formats support bulk off-heap scoring with the expected latency improvements.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- performance, search
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100