IO ITs: add validation of row content
Open
bug
core
java
P3
- Dominant language
- Java
- Stars
- 8.7k
- Forks
- 4.7k
- Avg merge
- 1d 20h
- Merged PRs (30d)
- 196
Description
We'd like to validate the contents of what we read from data stores more comprehensively than just counting the # of rows returned. Hashing the rows returned would be an easy way to do that.
Stores to convert:
Jdbc
Elasticsearch
Imported from Jira [BEAM-1643](https://issues.apache.org/jira/browse/BEAM-1643). Original Jira may contain additional context.
Reported by: sisk.
Contributor guide
Research direction
Start by locating the Jdbc and Elasticsearch IO integration tests and review how they currently validate returned row counts. Check the linked Jira issue for additional context; done means both stores validate row content, such as by hashing returned rows, rather than only counting rows.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- elasticsearch, java
- Domain
- data, testing-qa
- Issue type
- Feature
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100