GoogleCloudPlatform / GoogleCloudPlatform/PerfKitBenchmarker
Reporting time to create/delete major cloud resources
- Dominant language
- Python
- Stars
- 2k
- Forks
- 562
- Avg merge
- 4h 55m
- Merged PRs (30d)
- 69
Description
AFAIK, currently PKB only report resource creation/deletion time if the benchmark supports it (i.e cluster_boot).
We know that one key difference that makes cloud benchmarking different from the traditional benchmarking is that the times to allocate, configure and delete resources are metrics of interests. As [hinted here in this slide from one of the tech talks](https://docs.google.com/presentation/d/146bK4EP59Dh2vQEjAeECSjp-IJD6eFVwPvXLSTtS9LY/edit#slide=id.g8436545c6_0_304) written by @voellm.
Today, some of these measurements can be gathered or inferred from the logs, but I think they should be reported as part of the results summary for every provider that supports them.
I think for the most part we have converged to a certain set of resources, such as Network, Block Storage, Compute Instance (VM) and Firewall. Perhaps Object-Storage, Load Balancers, and others could become other kinds of resources in the future, but that's another issue. Starting to output resource creation/deletion metrics for these can be a start.
What do you think?
Contributor guide
Assessment
This issue has not been assessed yet.