apache / apache/lucene

add sort comparator that uses OrdinalMap [LUCENE-4969]

Open
#6,033 1 comment 0 reactions 0 assignees View on GitHub
legacy-jira-priority:Major type:enhancement
Dominant language
Java
Stars
3.6k
Forks
1.4k
Avg merge
2d 11h
Merged PRs (30d)
88

Description

OrdinalMap (LUCENE-4795, SOLR-4490) lets you trade off reopen time for faster faceting: it maps per-segment ordinals to a "global" space based on deviation from expected deltas.

We could add a sort comparator to the sandbox or similar that uses this, especially in the case you are using this for faceting anyway: you can then safely offload all terms bytes to disk (DiskDV) and still have performant sorting and faceting.

---
Migrated from [LUCENE-4969](https://issues.apache.org/jira/browse/LUCENE-4969) by Robert Muir (@rmuir)

Contributor guide

Open the contributing guide

Research direction

Start by reading OrdinalMap and the sandbox area for existing sort comparators. Trace how OrdinalMap supports faceting and how DiskDV stores term bytes, then identify the integration points for sorting. Done means a comparator can use the ordinal map while retaining performant sorting and faceting with terms bytes on disk.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
search
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.