apache / apache/lucene

FieldCache related test failure [LUCENE-5713]

Open
#6,775 4 comments 0 reactions 0 assignees View on GitHub
affects-version:6.0 legacy-jira-priority:Major type:bug
Dominant language
Java
Stars
3.6k
Forks
1.4k
Avg merge
2d 11h
Merged PRs (30d)
88

Description

The following reproduces for me and Varun V Shenoy on trunk:
lucene/spatial %>ant test -Dtestcase=SpatialOpRecursivePrefixTreeTest -Dtests.method=testContains -Dtests.seed=3AD27D1EB168088A

```
[junit4] 1> Strategy: RecursivePrefixTreeStrategy(SPG:(GeohashPrefixTree(maxLevels:2,ctx:SpatialContext.GEO)))
[junit4] 1> CheckReader failed
[junit4] 1> test: field norms.........OK [0 fields]
[junit4] 1> test: terms, freq, prox...OK [207 terms; 208 terms/docs pairs; 0 tokens]
[junit4] 1> test: stored fields.......OK [8 total field count; avg 2 fields per doc]
[junit4] 1> test: term vectors........OK [0 total vector count; avg 0 term/freq vector fields per doc]
[junit4] 1> test: docvalues...........ERROR [dv for field: SpatialOpRecursivePrefixTreeTest has -1 ord but is not marked missing for doc: 0]
[junit4] 1> java.lang.RuntimeException: dv for field: SpatialOpRecursivePrefixTreeTest has -1 ord but is not marked missing for doc: 0
[junit4] 1> at org.apache.lucene.index.CheckIndex.checkSortedDocValues(CheckIndex.java:1414)
[junit4] 1> at org.apache.lucene.index.CheckIndex.checkDocValues(CheckIndex.java:1536)
[junit4] 1> at org.apache.lucene.index.CheckIndex.testDocValues(CheckIndex.java:1367)
[junit4] 1> at org.apache.lucene.util.TestUtil.checkReader(TestUtil.java:229)
[junit4] 1> at org.apache.lucene.util.TestUtil.checkReader(TestUtil.java:216)
[junit4] 1> at org.apache.lucene.util.LuceneTestCase.newSearcher(LuceneTestCase.java:1597)
```

A 1-in-500 random condition hit to check the index on newSearcher, hitting this. DocValues used to not be enabled for this spatial test but @rmuir added it recently as part of the move to the DocValues API in lieu of the FieldCache API, and because the DisjointSpatialFilter uses getDocsWithField (though nothing else). That probably doesn't have anything to do with whatever the problem here is, though.

---
Migrated from [LUCENE-5713](https://issues.apache.org/jira/browse/LUCENE-5713) by David Smiley (@dsmiley), updated May 09 2016

Contributor guide

Open the contributing guide

Research direction

Run the reported ant command in lucene/spatial for SpatialOpRecursivePrefixTreeTest.testContains with the supplied seed. Start with the test's DocValues setup and the CheckIndex.checkSortedDocValues failure shown in the trace; done means the reproduction no longer reports an invalid -1 ordinal for a non-missing document.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
search, testing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
28/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.