Improve performance of SmartChineseAnalyzer [LUCENE-2023]
Open
legacy-jira-fix-version:4.9
legacy-jira-fix-version:6.0
legacy-jira-priority:Minor
module:analysis
type:enhancement
- Dominant language
- Java
- Stars
- 3.6k
- Forks
- 1.4k
- Avg merge
- 2d 11h
- Merged PRs (30d)
- 88
Description
I've noticed SmartChineseAnalyzer is a bit slow, compared to say CJKAnalyzer on chinese text.
This patch improves the internal hhmm implementation.
Time to index my chinese corpus is 75% of the previous time.
---
Migrated from [LUCENE-2023](https://issues.apache.org/jira/browse/LUCENE-2023) by Robert Muir (@rmuir), updated May 09 2016
Attachments: [LUCENE-2023.patch](https://apache.github.io/lucene-jira-archive/attachments/LUCENE-2023/LUCENE-2023.patch) (versions: 8)
Contributor guide
Assessment
This issue has not been assessed yet.