Combining analyzers output [LUCENE-3392]
- Dominant language
- Java
- Stars
- 3.6k
- Forks
- 1.4k
- Avg merge
- 2d 11h
- Merged PRs (30d)
- 88
Description
It should be easy to combine the output of multiple Analyzers, or TokenStreams.
A ComboAnalyzer and a ComboTokenStream class would take multiple instances, and multiplex their output, keeping a rough order of tokens like increasing position then increasing start offset then increasing end offset.
---
Migrated from [LUCENE-3392](https://issues.apache.org/jira/browse/LUCENE-3392) by Olivier Favre (@ofavre), updated May 09 2016
Attachments: [ComboAnalyzer-lucene3x.patch](https://apache.github.io/lucene-jira-archive/attachments/LUCENE-3392/ComboAnalyzer-lucene3x.patch) (versions: 2), [ComboAnalyzer-lucene-trunk.patch](https://apache.github.io/lucene-jira-archive/attachments/LUCENE-3392/ComboAnalyzer-lucene-trunk.patch)
Contributor guide
Research direction
Start by reviewing the attached ComboAnalyzer-lucene3x.patch and ComboAnalyzer-lucene-trunk.patch, then compare their approach with the current Analyzer and TokenStream APIs. Done means providing ComboAnalyzer and ComboTokenStream that multiplex multiple inputs while ordering tokens by position, start offset, and end offset as specified.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- search
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 30/100