opensearch-project / opensearch-project/data-prepper
Enable visibility duplication prevention by default
Nobody has claimed this yet.
- Dominant language
- Java
- Stars
- 374
- Forks
- 355
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 8
Description
Is your feature request related to a problem? Please describe.
Data Prepper's new feature to provide protection against premature visibility timeouts is very useful to avoid duplicate values. It should be the default value. But this may not work since it requires a new sqs permission.
Describe the solution you'd like
Change the default value to enabled. Do this in Data Prepper 3.0.
Describe alternatives you've considered (Optional)
Make this default now. But, this may result in many failed requests since this requires new permissions.
Additional context
See #2485 for the initial feature.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reading the initial visibility-duplication-prevention feature in #2485 and tracing where its default is configured. Confirm the default is enabled for Data Prepper 3.0, account for the required SQS permission, and verify the relevant behavior with the existing tests or validation for that feature.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- aws, java
- Domain
- backend, cloud
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 38/100