Upgrade to OpenNLP 2.x and add [LUCENE-10621]
- Dominant language
- Java
- Stars
- 3.6k
- Forks
- 1.4k
- Avg merge
- 2d 11h
- Merged PRs (30d)
- 88
Description
Apache OpenNLP 2.0.0 has been released. This [version](https://opennlp.apache.org/news/release-200.html) contains new implementations of TokenNameFinder and DocumentCategorizer that supports models in the ONNX format. (TokenNameFinder is in NLPNERTaggerOp, DocumentCategorizer is not currently exposed through Lucene.)
This task is update the OpenNLP dependency version to 2.0 and to add support for the new interface implementations in the OpenNLP analysis module that was added in #3973.
---
Migrated from [LUCENE-10621](https://issues.apache.org/jira/browse/LUCENE-10621) by Jeff Zemerick, 1 vote
Contributor guide
Research direction
Start with the OpenNLP dependency declaration and the analysis module added in #3973, then inspect NLPNERTaggerOp and its TokenNameFinder integration. Confirm which new OpenNLP 2.0 interfaces need exposure, and use the module's existing tests as the baseline. Done means the dependency is upgraded and the new implementations are supported without regressions.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- backend, search
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100