GoogleCloudPlatform / GoogleCloudPlatform/PerfKitBenchmarker
Control for OS/Package/Compiler differences
- Dominant language
- Python
- Stars
- 2k
- Forks
- 562
- Avg merge
- 4h 55m
- Merged PRs (30d)
- 69
Description
Would it make sense to create a "canonical" .VHD (and docker image) to include in with PerfKitBenchmarker that has all the appropriate libraries, compilers, and benchmark packages pre-installed?
Since it's possible to upload and use your own VHD/Container with all the cloud providers, this would make it possible to eliminate base OS differences as a source of problems with the benchmarks, and a source of argument for benchmark variability.
A pre-req for using perfkitbenchmarker could then be to upload the canonical image into your account/subscription for use by the tool.
(There's nothing really stopping individuals from doing this today, I suppose. Just wondering if a "blessed" version makes sense)
Contributor guide
Assessment
This issue has not been assessed yet.