GoogleCloudPlatform / GoogleCloudPlatform/PerfKitBenchmarker

Control for OS/Package/Compiler differences

Open
#150 8 comments 0 reactions 0 assignees View on GitHub
enhancement P1
Dominant language
Python
Stars
2k
Forks
562
Avg merge
4h 55m
Merged PRs (30d)
69

Description

Would it make sense to create a "canonical" .VHD (and docker image) to include in with PerfKitBenchmarker that has all the appropriate libraries, compilers, and benchmark packages pre-installed?

Since it's possible to upload and use your own VHD/Container with all the cloud providers, this would make it possible to eliminate base OS differences as a source of problems with the benchmarks, and a source of argument for benchmark variability.

A pre-req for using perfkitbenchmarker could then be to upload the canonical image into your account/subscription for use by the tool.

(There's nothing really stopping individuals from doing this today, I suppose. Just wondering if a "blessed" version makes sense)

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.