apache / apache/lucene

Some tokenfilters rely upon interned Types [LUCENE-3669]

Open
#4,743 0 comments 0 reactions 0 assignees View on GitHub
legacy-jira-priority:Major type:task
Dominant language
Java
Stars
3.6k
Forks
1.4k
Avg merge
2d 11h
Merged PRs (30d)
88

Description

at least StandardFilter and CJKBigramFilter.

it would be nice to not rely upon this, assuming there is no performance impact...

and we should check across the board for other filters.

---
Migrated from [LUCENE-3669](https://issues.apache.org/jira/browse/LUCENE-3669) by Robert Muir (@rmuir)

Contributor guide

Open the contributing guide

Research direction

Start by locating StandardFilter and CJKBigramFilter, then inspect other token filters for reliance on interned Types. Check the existing tests around these filters and compare behavior before and after changing the assumptions. Done means the identified filters no longer rely on interned Types without a performance regression, with coverage for the affected behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
search
Issue type
Refactor
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
30/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.