GoogleCloudPlatform / GoogleCloudPlatform/PerfKitBenchmarker

Reporting time to create/delete major cloud resources

Open
#1,015 3 comments 0 reactions 0 assignees View on GitHub
enhancement P1
Dominant language
Python
Stars
2k
Forks
562
Avg merge
4h 55m
Merged PRs (30d)
69

Description

AFAIK, currently PKB only report resource creation/deletion time if the benchmark supports it (i.e cluster_boot).

We know that one key difference that makes cloud benchmarking different from the traditional benchmarking is that the times to allocate, configure and delete resources are metrics of interests. As [hinted here in this slide from one of the tech talks](https://docs.google.com/presentation/d/146bK4EP59Dh2vQEjAeECSjp-IJD6eFVwPvXLSTtS9LY/edit#slide=id.g8436545c6_0_304) written by @voellm.

Today, some of these measurements can be gathered or inferred from the logs, but I think they should be reported as part of the results summary for every provider that supports them.

I think for the most part we have converged to a certain set of resources, such as Network, Block Storage, Compute Instance (VM) and Firewall. Perhaps Object-Storage, Load Balancers, and others could become other kinds of resources in the future, but that's another issue. Starting to output resource creation/deletion metrics for these can be a start.

What do you think?

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.