elastic / elastic/elastic-package

[ElasticSearch Transform] Deleted Documents Count Getting Doubled When All The IOC Expires

Open
#1,626 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Go
Stars
72
Forks
141
Avg merge
19h 42m
Merged PRs (30d)
55

Description

IOC transformation is working well with the below combinations:
1. Some active and some expired documents in the latest index.
2. All active documents in the latest index.
3. Zero documents in the latest index.

But when all the documents get expired then the deleted documents counts get doubled in the latest index.

Please find some screenshots of the Issue below:

Discover -

![image](https://github.com/elastic/elastic-package/assets/138874484/1d28d030-0d4c-40ab-b2f0-0d5cd1985150)

Latest Index -

![image](https://github.com/elastic/elastic-package/assets/138874484/ce22c2d3-d230-4af1-8fa5-df0f86edf6cf)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by inspecting the IOC transformation and reproducing the all-documents-expired case, comparing its deleted-document count with the active, mixed, and zero-document cases listed in the report. Done means the latest index reports the correct deleted count when all IOC documents expire.

Written by the indexing model from the issue text.

Assessment

Tech stack
elasticsearch, go
Domain
data, search
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.