apache / apache/lucene

Reverse FST storage so it can be read forward [LUCENE-8653]

Open
#9,699 5 comments 0 reactions 0 assignees View on GitHub
legacy-jira-priority:Major module:core/FSTs type:enhancement
Dominant language
Java
Stars
3.6k
Forks
1.4k
Avg merge
2d 11h
Merged PRs (30d)
88

Description

Discussion of keeping FST off-heap led to the idea of ensuring that FST's can be read forward in order to be more cache-friendly and align better with standard I/O practice. Today FSTs are read in reverse and this leads to some awkwardness, and you can't use standard readers so the code can be confusing to work with.

---
Migrated from [LUCENE-8653](https://issues.apache.org/jira/browse/LUCENE-8653) by Michael Sokolov (@msokolov), updated Jan 23 2019
Attachments: [fst-reverse.patch](https://apache.github.io/lucene-jira-archive/attachments/LUCENE-8653/fst-reverse.patch)

Contributor guide

Open the contributing guide

Research direction

Start by reading the issue discussion and the attached fst-reverse.patch from the migrated LUCENE-8653 report. Determine how FST storage is currently read in reverse and define the changes needed for forward reading; done means FSTs can be read forward and standard readers can be used.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
search
Issue type
Refactor
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.