GoogleCloudPlatform / GoogleCloudPlatform/professional-services-data-validator
Dataflow Template: Improve load tests
Open
dataflow template
priority: p2
- Dominant language
- Python
- Stars
- 524
- Forks
- 171
- Avg merge
- 5d 15h
- Merged PRs (30d)
- 4
Description
Currently, there is a single 100 GB load test against BQ. We should investigate:
1. Parameterizing the load test so we can easily test scales other than 100 GB.
2. Parameterizing the load test so we can easily test systems other than BQ.
3. Truncating the results table after each load test. At the moment, running multiple load tests just piles up data in the results table until you manually truncate it.
Contributor guide
Assessment
This issue has not been assessed yet.