CommonGramFilter should work on stacked tokens. [LUCENE-8209]
- Dominant language
- Java
- Stars
- 3.6k
- Forks
- 1.4k
- Avg merge
- 2d 11h
- Merged PRs (30d)
- 88
Description
Currently it doesn't.
ShingleFilter has the same issue but CommonGramFilter might be easier to fix given that it supports fewer options and only needs to work at index time (ie. no need to be able to consume graphs).
CommonGramsQueryFilter might be a bit harder to fix if we want to make it support arbitrary graph inputs.
---
Migrated from [LUCENE-8209](https://issues.apache.org/jira/browse/LUCENE-8209) by Adrien Grand (@jpountz)
Contributor guide
Research direction
Start by reading CommonGramFilter and comparing its stacked-token behavior with the related ShingleFilter issue. The change is complete when CommonGramFilter works with stacked tokens at index time; arbitrary graph input for CommonGramsQueryFilter is outside this issue.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- search
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100