apache / apache/lucene

TestPointQueries.testRandomBinaryMedium() failure [LUCENE-7175]

Open
#8,230 7 comments 0 reactions 0 assignees View on GitHub
legacy-jira-priority:Minor type:bug
Dominant language
Java
Stars
3.6k
Forks
1.4k
Avg merge
2d 11h
Merged PRs (30d)
88

Description

My Jenkins found a failure on branch_6_0 that does not reproduce for me:

```
Checking out Revision 48c80f91b8e5cd9b3a9b48e6184bd53e7619e7e3 (refs/remotes/origin/branch_6_0)
[...]
[junit4] Suite: org.apache.lucene.search.TestPointQueries
[junit4] 2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestPointQueries -Dtests.method=testRandomBinaryMedium -Dtests.seed=9C435B953E7FAA90 -Dtests.slow=true -Dtests.linedocsfile=/home/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=es-CU -Dtests.timezone=America/Coral_Harbour -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] FAILURE 0.22s J0 | TestPointQueries.testRandomBinaryMedium <<<
[junit4] > Throwable #1: java.lang.AssertionError
[junit4] > at __randomizedtesting.SeedInfo.seed([9C435B953E7FAA90:EB6EDCD5EAD3DF47]:0)
[junit4] > at org.apache.lucene.codecs.asserting.AssertingLiveDocsFormat.newLiveDocs(AssertingLiveDocsFormat.java:43)
[junit4] > at org.apache.lucene.index.FreqProxTermsWriter.applyDeletes(FreqProxTermsWriter.java:66)
[junit4] > at org.apache.lucene.index.FreqProxTermsWriter.flush(FreqProxTermsWriter.java:102)
[junit4] > at org.apache.lucene.index.DefaultIndexingChain.flush(DefaultIndexingChain.java:134)
[junit4] > at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:423)
[junit4] > at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:502)
[junit4] > at org.apache.lucene.index.DocumentsWriter.postUpdate(DocumentsWriter.java:376)
[junit4] > at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:466)
[junit4] > at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1492)
[junit4] > at org.apache.lucene.index.IndexWriter.addDocument(IndexWriter.java:1271)
[junit4] > at org.apache.lucene.index.RandomIndexWriter.addDocument(RandomIndexWriter.java:170)
[junit4] > at org.apache.lucene.search.TestPointQueries.verifyBinary(TestPointQueries.java:700)
[junit4] > at org.apache.lucene.search.TestPointQueries.doTestRandomBinary(TestPointQueries.java:645)
[junit4] > at org.apache.lucene.search.TestPointQueries.testRandomBinaryMedium(TestPointQueries.java:605)
[junit4] > at java.lang.Thread.run(Thread.java:745)
[junit4] IGNOR/A 0.00s J0 | TestPointQueries.testRandomLongsBig
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] IGNOR/A 0.00s J0 | TestPointQueries.testRandomBinaryBig
[junit4] > Assumption #1: 'nightly' test group is disabled (@Nightly())
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene60): {id=PostingsFormat(name=Memory doPackFST= false)}, docValues:{id=DocValuesFormat(name=Lucene54), value=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=509, maxMBSortInHeap=4.942919619081517, sim=ClassicSimilarity, locale=es-CU, timezone=America/Coral_Harbour
[junit4] 2> NOTE: Linux 4.1.0-custom2-amd64 amd64/Oracle Corporation 1.8.0_45 (64-bit)/cpus=16,threads=1,free=190701352,total=379060224
[junit4] 2> NOTE: All tests run in this JVM: [TestLegacyNumericUtils, TestRAMDirectory, TestRamUsageEstimator, TestMultiCollector, TestSpanSearchEquivalence, TestIndexWriterNRTIsCurrent, TestNRTCachingDirectory, TestIndexInput, TestIndexWriterReader, TestTopDocsMerge, TestSortRandom, TestSearchWithThreads, TestRateLimiter, TestSpanTermQuery, TestLockFactory, TestComplexExplanations, TestHighCompressionMode, TestMinShouldMatch2, TestTransactionRollback, TestIndexWriterCommit, TestIndexWriterOnJRECrash, TestPrefixRandom, TestFieldCacheRewriteMethod, TestOperations, TestPositionIncrement, TestIndexReaderClose, TestSloppyPhraseQuery, TestNRTReaderWithThreads, TestLucene53NormsFormat, TestSimpleExplanationsOfNonMatches, TestTimSorter, TestTermsEnum2, TestDocValuesRewriteMethod, TestDirectPacked, TestMatchAllDocsQuery, TestMergeSchedulerExternal, TestPrefixQuery, TestTimeLimitingCollector, TestSameTokenSamePosition, TestCharTermAttributeImpl, TestPriorityQueue, TestIOUtils, TestSearchAfter, TestSortRescorer, TestIndexWriterDeleteByQuery, TestStressNRT, TestOmitPositions, TestMaxPosition, TestFlushByRamOrCountsPolicy, TestExceedMaxTermLength, TestForTooMuchCloning, TestIndexCommit, TestDocIdSetBuilder, TestNamedSPILoader, TestRecyclingIntBlockAllocator, TestNumericRangeQuery32, TestQueryCachingPolicy, TestLucene50FieldInfoFormat, TestIndexWriterDelete, TestTermVectorsReader, TestMultiPhraseQuery, TestStringHelper, TestDocValuesIndexing, TestTermVectorsWriter, TestBasics, TestRegexpRandom2, TestCodecUtil, TestField, TestSloppyPhraseQuery2, TestSpanNotQuery, TestTermVectors, TestRegexpRandom, Test2BBKDPoints, TestCodecs, TestAtomicUpdate, TestSegmentInfos, TestSimpleFSDirectory, TestGrowableByteArrayDataOutput, TestMultiDocValues, TestFastDecompressionMode, TestRoaringDocIdSet, TestTermScorer, TestBlockPostingsFormat3, TestShardSearching, MultiCollectorTest, TestReqExclBulkScorer, TestBlendedTermQuery, TestPagedBytes, TestForUtil, TestMixedCodecs, TestUniqueTermCount, TestNoMergeScheduler, TestAttributeSource, TestSingleInstanceLockFactory, TestTermsEnum, TestDuelingCodecs, TestSimilarity, TestPerFieldPostingsFormat2, TestNeverDelete, TestFieldValueQuery, TestBinaryDocument, TestInfoStream, TestLongPostings, TestSimpleSearchEquivalence, TestPointValues, TestLucene50TermVectorsFormat, TestPointQueries]
[junit4] Completed [208/414 (1!)] on J0 in 3.38s, 45 tests, 1 failure, 2 skipped <<< FAILURES!

```

---
Migrated from [LUCENE-7175](https://issues.apache.org/jira/browse/LUCENE-7175) by Steven Rowe (@sarowe), updated Apr 24 2016

Contributor guide

Open the contributing guide

Research direction

Start by running the reported ant test command for TestPointQueries.testRandomBinaryMedium with the supplied seed and parameters. Trace the failure from TestPointQueries.verifyBinary at line 700 through FreqProxTermsWriter and AssertingLiveDocsFormat, using the named stack-trace files as entry points. Done means the failure is understood and the reproduced test passes without regressing the surrounding indexing tests.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
backend, search, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.