opensearch-project / opensearch-project/data-prepper
Support gradle parallel in test tasks
Nobody has claimed this yet.
- Dominant language
- Java
- Stars
- 374
- Forks
- 355
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 8
Description
Is your feature request related to a problem? Please describe.
The following gradle tasks fail intermittently when using the --parallel flag
- test
- :e2e-test:log:basicLogEndToEndTest
- :e2e-test:trace:rawSpanEndToEndTest
- :e2e-test:trace:rawSpanCompatibilityEndToEndTest
- :e2e-test:trace:serviceMapEndToEndTest
Describe the solution you'd like
- Refactor tests that rely on a running data prepper instance to use a random open port
- Refactor integration tests to use a shared instance of OpenSearch. Each test can use a different index to prevent interference.
- Refactor gradle tasks that build a Data Prepper image for testing to run a base image then mount any jars and configuration files at runtime.
Describe alternatives you've considered (Optional)
Run integrations test code in a new container to allow multiple tests to run simultaneously.
Additional context
n/a
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start by reproducing the listed Gradle tasks with the --parallel flag, especially test and the named end-to-end tasks. Trace which tests require a running Data Prepper or shared OpenSearch instance, then assess the image-building tasks. Done means the listed tasks run reliably in parallel without test interference.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- build-system, testing-qa
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 20/100