apache / apache/lucene

Add bulk off-heap scoring for vector formats

Open
#15,155 0 comments 0 reactions 0 assignees View on GitHub
type:enhancement vector-based-search
Dominant language
Java
Stars
3.6k
Forks
1.4k
Avg merge
2d 11h
Merged PRs (30d)
88

Description

### Description

We found some pretty awesome latency improvements with float32 vectors bulk scoring off-heap. It makes me think we can get nice improvements for byte vectors and all the quantized formats.

See: https://github.com/apache/lucene/pull/14980

&: https://github.com/apache/lucene/pull/14978

Contributor guide

Open the contributing guide

Research direction

Start by reviewing the linked PRs 14980 and 14978 to understand the existing float32 off-heap bulk-scoring work and its entry points. Trace how that approach applies to byte vectors and the quantized formats, then verify that those formats support bulk off-heap scoring with the expected latency improvements.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
performance, search
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.