apache / apache/lucene

Preview issue [LUCENE-5697]

Open
#6,759 1 comment 0 reactions 0 assignees View on GitHub
legacy-jira-priority:Major module:highlighter type:bug
Dominant language
Java
Stars
3.6k
Forks
1.4k
Avg merge
2d 11h
Merged PRs (30d)
88

Description

In DocFetcher, which uses Lucene v3.5.0, we stumbled on a bug. The lead of DocFetcher has investigated and found the problem seems to be in Lucene. I do not know if this bug has been fixed in a later Lucene version.

Issue:
We use "proximity search": search on multiple words in a directory with about 300 PDF files.
E.g. search for "wordA wordB wordC"\~50, i.e. three words within 50 words distance of each other. The resulting documents are correct. But the highligted text in the document is often missing.

If the words are in the SAME order as in the search AND on the SAME page, then the higlight works correct. But if the order of the words is different from the search (like "wordA wordC wordB" OR the words are not on the same page, then that text is not highlighted.

As we use the proximity search on multiple words often, it severely degrades the usability.

---
Migrated from [LUCENE-5697](https://issues.apache.org/jira/browse/LUCENE-5697) by Martin Schoenmakers, updated Jun 05 2014
Environment:
```
DocFetcher 1.1.11 on Win 7(64) pro
```

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the reported proximity-search highlighting behavior from DocFetcher 1.1.11 with Lucene 3.5.0, using reordered terms and terms on different pages. Compare the search results with the highlighted text and determine whether the behavior remains in a later Lucene version. Done means the highlighting behavior is characterized and a fix or confirmed version status is established.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
search
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.