apache / apache/lucene

TestStemmerOverrideFilter.testRandomRealisticWhiteSpace() failure [LUCENE-8372]

Open
#9,419 1 comment 0 reactions 0 assignees View on GitHub
legacy-jira-priority:Major module:analysis type:bug
Dominant language
Java
Stars
3.6k
Forks
1.4k
Avg merge
2d 11h
Merged PRs (30d)
88

Description

ASF Jenkins found a reproducing seed for a `TestStemmerOverrideFilter.testRandomRealisticWhiteSpace()` failure :

```
Checking out Revision a929003f5b2792dedef6563203a86b99ac54e5df (refs/remotes/origin/master)
[...]
[smoker] [junit4] Suite: org.apache.lucene.analysis.miscellaneous.TestStemmerOverrideFilter
[smoker] [junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestStemmerOverrideFilter -Dtests.method=testRandomRealisticWhiteSpace -Dtests.seed=8BD0C00B1FC9F3CA -Dtests.multiplier=2 -Dtests.locale=hr -Dtests.timezone=America/Martinique -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[smoker] [junit4] FAILURE 0.01s J2 | TestStemmerOverrideFilter.testRandomRealisticWhiteSpace <<<
[smoker] [junit4] > Throwable #1: org.junit.ComparisonFailure: term 18 expected:<[nicgxi]> but was:<[lby]>
[smoker] [junit4] > at __randomizedtesting.SeedInfo.seed([8BD0C00B1FC9F3CA:2727A1D89DBBDDF7]:0)
[smoker] [junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:199)
[smoker] [junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:320)
[smoker] [junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:324)
[smoker] [junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:328)
[smoker] [junit4] > at org.apache.lucene.analysis.BaseTokenStreamTestCase.assertTokenStreamContents(BaseTokenStreamTestCase.java:344)
[smoker] [junit4] > at org.apache.lucene.analysis.miscellaneous.TestStemmerOverrideFilter.testRandomRealisticWhiteSpace(TestStemmerOverrideFilter.java:140)
[smoker] [junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[smoker] [junit4] > at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
[smoker] [junit4] > at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[smoker] [junit4] > at java.base/java.lang.reflect.Method.invoke(Method.java:564)
[smoker] [junit4] > at java.base/java.lang.Thread.run(Thread.java:844)
[smoker] [junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1291, maxMBSortInHeap=5.50786279653026, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@1e881cd3), locale=hr, timezone=America/Martinique
[smoker] [junit4] 2> NOTE: Linux 3.13.0-88-generic amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=4,threads=1,free=214015624,total=275775488
```

---
Migrated from [LUCENE-8372](https://issues.apache.org/jira/browse/LUCENE-8372) by Steven Rowe (@sarowe)
Linked issues:
- #9056

Contributor guide

Open the contributing guide

Research direction

Start with org.apache.lucene.analysis.miscellaneous.TestStemmerOverrideFilter.testRandomRealisticWhiteSpace() at TestStemmerOverrideFilter.java:140. Run the reported ant test command with seed 8BD0C00B1FC9F3CA and inspect why term 18 differs, expected nicgxi but received lby. Done means the reproducer passes reliably and the underlying failure is fixed.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
search
Issue type
Bug
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.