apache / apache/lucene

Use DirectMonotonicWriter for blocks in NumericDocValues

Open
#12,422 0 comments 0 reactions 0 assignees View on GitHub
type:enhancement
Dominant language
Java
Stars
3.6k
Forks
1.4k
Avg merge
2d 11h
Merged PRs (30d)
88

Description

### Description

currently we use DirectMonotonicWriter for store address/offset for some meta data, It has a higher compression ratio for increasing sequences of integers, can we also use it to write docvalue block for index sorting case?

Contributor guide

Open the contributing guide

Research direction

Start by locating the existing DirectMonotonicWriter uses for metadata and the NumericDocValues block-writing path used for index sorting. Compare how increasing addresses or offsets are currently written and identify the relevant Lucene tests or benchmarks; done means the approach is implemented and its compression and behavior are verified.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
search
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
42/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.