apache / apache/lucene

Benefit from OpenNLP's new UD models

Open
#14,188 0 comments 3 reactions 1 assignee Claimed by @msfroh View on GitHub
type:enhancement
Dominant language
Java
Stars
3.6k
Forks
1.4k
Avg merge
2d 11h
Merged PRs (30d)
88

Description

### Description

We recently upgraded Lucene's dependency on OpenNLP to 2.5. This upgrade offers a new part-of-speech tagging model that works across more languages. The update maintained backward compatibility with the old Penn model by hardcoding it in the token filter.

We should expose the UD model as an option.

I'd like to work on this, so please assign it to me.

@mawiesne, you're the OpenNLP expert, please let me know about potential pitfalls. I don't know OpenNLP, but this seems fun.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.