apache / apache/lucene

CheckIndex: pre-exorcise document id salvage [LUCENE-8961]

Open
#10,004 6 comments 0 reactions 0 assignees View on GitHub
legacy-jira-priority:Minor type:enhancement
Dominant language
Java
Stars
3.6k
Forks
1.4k
Avg merge
2d 11h
Merged PRs (30d)
88

Description

The [CheckIndex](https://github.com/apache/lucene-solr/blob/releases/lucene-solr/8.2.0/lucene/core/src/java/org/apache/lucene/index/CheckIndex.java) tool supports the exorcising of corrupt segments from an index.

This ticket proposes to add an extra option which could first be used to potentially salvage the document ids of the segment(s) about to be exorcised. Re-ingestion for those documents could then be arranged so as to repair the data damage caused by the exorcising.

---
Migrated from [LUCENE-8961](https://issues.apache.org/jira/browse/LUCENE-8961) by Christine Poerschke (@cpoerschke), updated Oct 01 2019
Attachments: [LUCENE-8961.patch](https://apache.github.io/lucene-jira-archive/attachments/LUCENE-8961/LUCENE-8961.patch) (versions: 2)

Contributor guide

Open the contributing guide

Research direction

Start with CheckIndex.java and the attached LUCENE-8961.patch to understand the existing exorcise flow and proposed option. Trace how the CheckIndex tool identifies segments for removal, then define how document IDs would be salvaged before exorcising; done means the option works without changing the existing exorcise behavior.

Written by the indexing model from the issue text.

Assessment

Tech stack
java
Domain
search
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.