Add FST Offheap for non-default Codecs [LUCENE-8783]
Open
legacy-jira-fix-version:8.0
legacy-jira-fix-version:8.x
legacy-jira-priority:Major
module:core/FSTs
type:enhancement
- Dominant language
- Java
- Stars
- 3.6k
- Forks
- 1.4k
- Avg merge
- 2d 11h
- Merged PRs (30d)
- 88
Description
Even though, #9681 and #9717 adds support to keep FST offheap for default codec, there are many other codecs which do not support FST offheap. Few examples are below:
- CompletionPostingsFormat
- BlockTreeOrdsPostingsFormat
- IDVersionPostingsFormat
---
Migrated from [LUCENE-8783](https://issues.apache.org/jira/browse/LUCENE-8783) by Ankit Jain, updated Dec 08 2021
Contributor guide
Research direction
Start by reviewing the changes in #9681 and #9717, then inspect how CompletionPostingsFormat, BlockTreeOrdsPostingsFormat, and IDVersionPostingsFormat handle FST storage. Done means these non-default codecs support keeping their FST off-heap without breaking their existing behavior.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- search
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 32/100