[FEA] CAGRA merge to handle deletes
Nobody has claimed this yet.
- Dominant language
- Cuda
- Stars
- 854
- Forks
- 236
- Avg merge
- 3d 3h
- Merged PRs (30d)
- 62
Description
When CAGRA indexes are part of Lucene segments, Lucene merge would call CAGRA merge for merging the underlying indexes. However, if there are recent deletes in the older segments, then Lucene merge usually purges those deleted documents during the merge process and the resulting merged segment doesn't have those deleted documents. It would be nice to have similar support in CAGRA, i.e. while merging, pass in a filter to remove certain documents from the merged CAGRA index.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by tracing how CAGRA indexes are merged when they are part of Lucene segments, then inspect the existing merge entry points and how Lucene represents deleted documents. The issue does not name files or tests; done means defining and validating merge behavior that excludes documents removed during the Lucene merge.
Written by the indexing model from the issue text.
Assessment
- Domain
- search
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100