Add more robust testing to streaming ingestion integration tests
Open
Area - Testing
Contributions Welcome
Feature/Change Description
Starter
- Dominant language
- Java
- Stars
- 14.1k
- Forks
- 3.8k
- Avg merge
- 2d 58m
- Merged PRs (30d)
- 233
Description
### Description
Add more robust testing to streaming ingestion integration tests. Modify the `SyntheticStreamGenerator` to generate different format of data, including but not limited to invalid format, null/empty data, multi-rows data, etc.
Contributor guide
Research direction
Locate the SyntheticStreamGenerator and the streaming ingestion integration tests, then read how test data is currently produced and asserted. Run the existing integration test suite before changing the generator. Done means the tests exercise invalid, null or empty, and multi-row data formats and reliably verify the ingestion outcomes.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java
- Domain
- data-engineering, stream-processing, testing-qa
- Issue type
- Feature
- Difficulty
- 3/5
- Estimated time
- 1-2 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100