Assertion error in KoreanTokenizer [LUCENE-10086]
Open
legacy-jira-priority:Major
type:bug
- Dominant language
- Java
- Stars
- 3.6k
- Forks
- 1.4k
- Avg merge
- 2d 11h
- Merged PRs (30d)
- 88
Description
This is a follow-up of #11097, KoreanTokenizer has the same issue as JapaneseTokenizer in the backtrace step.
The fix would be similar to
---
Migrated from [LUCENE-10086](https://issues.apache.org/jira/browse/LUCENE-10086) by Anh Dung Bui, updated Sep 30 2021
Pull requests: https://github.com/apache/lucene/pull/285
Contributor guide
Research direction
Start at the KoreanTokenizer backtrace step and compare it with the corresponding JapaneseTokenizer issue described in #11097. Review PR #254 for the referenced analogous fix and PR #285 for the existing work; done means the KoreanTokenizer assertion is resolved for the reported case.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- search
- Issue type
- Bug
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100