opensearch-project / opensearch-project/data-prepper
Opensearch sink should support bulk delete, update by query and delete by query
Nobody has claimed this yet.
- Dominant language
- Java
- Stars
- 374
- Forks
- 354
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 8
Description
Is your feature request related to a problem? Please describe.
Opensearch sink should support bulk delete, update by query and delete by query
Describe the solution you'd like
Add options to opensearch sink to update/delete by query and also do bulk delete. Bulk delete is supported as part of BulkRequest. Not sure if there is a better option for bulk delete.
Describe alternatives you've considered (Optional)
A clear and concise description of any alternative solutions or features you've considered.
Additional context
Add any other context or screenshots about the feature request here.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by locating the OpenSearch sink and its BulkRequest handling. Review how sink options are defined and how requests are dispatched, then determine the expected behavior for bulk delete, update by query, and delete by query. Done means the three operations are exposed as supported sink options and covered by the relevant tests.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- backend, data-engineering
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 30/100