apache / apache/lucene

Should we make TrieBuilder off-heap

Open
#15,188 0 comments 0 reactions 0 assignees View on GitHub
type:enhancement
Dominant language
Java
Stars
3.6k
Forks
1.4k
Avg merge
2d 11h
Merged PRs (30d)
88

Description

### Description

`TrieBuilder` has replaced FST in the block term index. I'm wondering if it makes sense to also make it off-heap, enabling use case such as building a large term trie (similar to `FSTPostingFormat`).

Contributor guide

Open the contributing guide

Research direction

Start by reading TrieBuilder's role in the block term index and compare it with FSTPostingFormat, which the issue cites as a similar use case. Determine whether off-heap construction is technically and operationally justified for large term tries; done means a documented design decision and an agreed implementation scope.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
search
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.