GoogleCloudPlatform/PerfKitBenchmarker

View on GitHub

PerfKit Benchmarker (PKB) contains a set of benchmarks to measure and compare cloud offerings. The benchmarks use default settings to reflect what most users will see. PerfKit Benchmarker is licensed under the Apache 2 license terms. Please make sure to read, understand and agree to the terms of the LICENSE and CONTRIBUTING files before proceeding.

Stars: 2k
Forks: 562
Open beginner issues: 0
Indexed issues: 220
Avg merge: 4h 55m
Merged PRs (30d): 69

Dominant language: Python
License: Apache-2.0
Last GitHub push: Sep 14, 2026
Latest indexed: Sep 16, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue help wanted

Open All

220 open issues indexed

Multistream object storage benchmark sometimes has stddev of 0 when not 0. Open

P0

GoogleCloudPlatform/PerfKitBenchmarker#939 · 1 comment · 0 reactions · 1 assignee · Indexed Sep 16, 2026
Multistream object storage benchmark has scalability issue Open

P0

GoogleCloudPlatform/PerfKitBenchmarker#940 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 16, 2026
README.md is abiguous/misleading about OS_TENANT environment variable for OpenStack Open

enhancement P1

GoogleCloudPlatform/PerfKitBenchmarker#966 · 3 comments · 1 reaction · 0 assignees · Indexed Sep 16, 2026
Support AWS signature version 4 in object storage benchmarks Open

enhancement P1

GoogleCloudPlatform/PerfKitBenchmarker#980 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 16, 2026
Deprecate bonnie++, aerospike, and redis benchmarks Open

enhancement P1

GoogleCloudPlatform/PerfKitBenchmarker#981 · 3 comments · 0 reactions · 1 assignee · Indexed Sep 16, 2026
NotFound: No Network matching {'label': 'private'}. (HTTP 404) Open

help wanted P1

GoogleCloudPlatform/PerfKitBenchmarker#991 · 6 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
alicloud：Got exception running Create: No JSON object could be decoded Open

help wanted P1

GoogleCloudPlatform/PerfKitBenchmarker#1004 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Running CoreMark benchmark on Windows Open

help wanted P1

GoogleCloudPlatform/PerfKitBenchmarker#1009 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Support for cloud Apache Spark Clusters Open

enhancement P1

GoogleCloudPlatform/PerfKitBenchmarker#1010 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Reporting time to create/delete major cloud resources Open

enhancement P1

GoogleCloudPlatform/PerfKitBenchmarker#1015 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Cassandra_stress and Redis use more VMs than requested machine_type Open

help wanted P1

GoogleCloudPlatform/PerfKitBenchmarker#1016 · 4 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Use of a single perfkit_sc_group is undesirable Open

enhancement

GoogleCloudPlatform/PerfKitBenchmarker#1024 · 0 comments · 0 reactions · 1 assignee · Indexed Sep 16, 2026
Support YCSB_TAR_URL override Open

enhancement P1

GoogleCloudPlatform/PerfKitBenchmarker#1026 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Update network creation for GCP Open

enhancement P1

GoogleCloudPlatform/PerfKitBenchmarker#1030 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
PKB community meeting #8 - When should we have this? Open

GoogleCloudPlatform/PerfKitBenchmarker#1036 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Benchmark produces scores but result is failed Open

enhancement P1

GoogleCloudPlatform/PerfKitBenchmarker#1039 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Cluster_boot random failures Open

bug P1

GoogleCloudPlatform/PerfKitBenchmarker#1040 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Static VMs are re-used if multiple benchmarks are included in the same command line Open

enhancement P1

GoogleCloudPlatform/PerfKitBenchmarker#1041 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Implement DigitalOcean block storage Open

enhancement P1

GoogleCloudPlatform/PerfKitBenchmarker#1054 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 16, 2026
Networking benchmark use internal IP to ping, so VMs on different subnets are not reachable Open

help wanted P1

GoogleCloudPlatform/PerfKitBenchmarker#1056 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Handle cleanup failure separate from failure Open

enhancement P1

GoogleCloudPlatform/PerfKitBenchmarker#1058 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Create separate steps for Install and Prepare Open

enhancement P1

GoogleCloudPlatform/PerfKitBenchmarker#1059 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Bonnie++ benchmarking error. Should add uid when running as root. Open

enhancement P1

GoogleCloudPlatform/PerfKitBenchmarker#1071 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Failed to build collectd Open

bug P1

GoogleCloudPlatform/PerfKitBenchmarker#1082 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
RobustRemoteCommand() makes implicit assumption that python is available in the path Open

bug

GoogleCloudPlatform/PerfKitBenchmarker#1095 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
spec2006 fp test failed with 416.gamess and 481.wrf Open

GoogleCloudPlatform/PerfKitBenchmarker#1120 · 9 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
hbase_ycsb‘ result of overall Throughput is zero Open

GoogleCloudPlatform/PerfKitBenchmarker#1121 · 10 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
OpenStack "openstack_volume_size" not included in json results output Open

GoogleCloudPlatform/PerfKitBenchmarker#1122 · 5 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
gsutil hangs on cleanup Open

GoogleCloudPlatform/PerfKitBenchmarker#1167 · 3 comments · 1 reaction · 0 assignees · Indexed Sep 16, 2026
Static virtual machine files should use YAML, not JSON Open

GoogleCloudPlatform/PerfKitBenchmarker#1224 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Hard-to-debug error behavior with static VMs Open

GoogleCloudPlatform/PerfKitBenchmarker#1225 · 1 comment · 0 reactions · 1 assignee · Indexed Sep 16, 2026
object_storage_service fails during cleanup - tries to delete instance, firewall and network multiple times, after successful STDERR of it being deleted Open

GoogleCloudPlatform/PerfKitBenchmarker#1239 · 11 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Linode support Open

enhancement

GoogleCloudPlatform/PerfKitBenchmarker#1247 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
OpenStack subnet info issue Open

bug

GoogleCloudPlatform/PerfKitBenchmarker#1248 · 2 comments · 0 reactions · 1 assignee · Indexed Sep 16, 2026
mesh_network: desired confidence was not achieved Open

help wanted

GoogleCloudPlatform/PerfKitBenchmarker#1259 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
PerfKitBenchmarker VMware provider Open

question

GoogleCloudPlatform/PerfKitBenchmarker#1260 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Missing benchmarks in README list Open

P2

GoogleCloudPlatform/PerfKitBenchmarker#1266 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Please include IBM Softlayer (now Bluemix) in description Open

GoogleCloudPlatform/PerfKitBenchmarker#1286 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 16, 2026
PerKit Benchmarker with PerfKit Explorer how to handle? Open

GoogleCloudPlatform/PerfKitBenchmarker#1296 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Don't run all benchmarks if none are specified Open

enhancement

GoogleCloudPlatform/PerfKitBenchmarker#1305 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Nonexistent benchmark should give better error message Open

GoogleCloudPlatform/PerfKitBenchmarker#1310 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Verify spark_service_type flag is unused and remove Open

GoogleCloudPlatform/PerfKitBenchmarker#1315 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Verify blazemark_kernels flag is unused and remove Open

GoogleCloudPlatform/PerfKitBenchmarker#1316 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
cloudsuite websearch gets stuck on ubuntu1604 Open

GoogleCloudPlatform/PerfKitBenchmarker#1339 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Provide an example to use --openstack_additional_flags Open

question

GoogleCloudPlatform/PerfKitBenchmarker#1353 · 3 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
GetDefaultProject is duplicated in cloud_bigtable_ycsb_benchmark Open

internal cleanup

GoogleCloudPlatform/PerfKitBenchmarker#1377 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
CI integration does not run check-boilerplate.sh Open

GoogleCloudPlatform/PerfKitBenchmarker#1400 · 0 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026
Catch false failures for mysql_service with high thread counts Open

GoogleCloudPlatform/PerfKitBenchmarker#1451 · 1 comment · 0 reactions · 0 assignees · Indexed Sep 16, 2026
"no module named fcntl" issue in Windows 7 Open

GoogleCloudPlatform/PerfKitBenchmarker#1485 · 0 comments · 1 reaction · 0 assignees · Indexed Sep 16, 2026
Benchmark KVM without cloud provisioning Open

GoogleCloudPlatform/PerfKitBenchmarker#1535 · 2 comments · 0 reactions · 0 assignees · Indexed Sep 16, 2026

GoogleCloudPlatform/PerfKitBenchmarker

Get new issues in your inbox