cockroachdb / cockroachdb/cockroach
roachtest: cluster_creation failed
- Dominant language
- Go
- Stars
- 32.5k
- Forks
- 4.1k
- PR merge metrics
- PR metrics pending
Description
roachtest.cluster_creation [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyGceBazel/20329104?buildTab=log) with [artifacts](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyGceBazel/20329104?buildTab=artifacts#/ycsb/C/nodes=3/cpu=32/mvcc-range-keys=global) on release-25.2 @ [07deb794885b5da6d3fda42bde9e028371df5adf](https://github.com/cockroachdb/cockroach/commits/07deb794885b5da6d3fda42bde9e028371df5adf):
```
test ycsb/C/nodes=3/cpu=32/mvcc-range-keys=global failed: (test_runner.go:840).func4: in provider: gce: Command: gcloud [compute instances create --subnet default --format json --labels spot=true,usage=roachtest,roachtest-branch=release-25-2,cluster=teamcity-20329104-1754977235-190-n4cpu32,lifetime=12h0m0s,arch=amd64,created=2025-08-12t14_40_48z,roachprod=true --scopes cloud-platform --image ubuntu-2204-jammy-v20240319 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --provisioning-model SPOT --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --machine-type n2-custom-32-65536 --min-cpu-platform Intel Ice Lake --metadata-from-file startup-script=/tmp/gce-startup-script166848342 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-d teamcity-20329104-1754977235-190-n4cpu32-0001 teamcity-20329104-1754977235-190-n4cpu32-0002 teamcity-20329104-1754977235-190-n4cpu32-0003]: failed to run: gcloud compute instances create --subnet default --format json --labels spot=true,usage=roachtest,roachtest-branch=release-25-2,cluster=teamcity-20329104-1754977235-190-n4cpu32,lifetime=12h0m0s,arch=amd64,created=2025-08-12t14_40_48z,roachprod=true --scopes cloud-platform --image ubuntu-2204-jammy-v20240319 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --provisioning-model SPOT --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --machine-type n2-custom-32-65536 --min-cpu-platform Intel Ice Lake --metadata-from-file startup-script=/tmp/gce-startup-script166848342 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-d teamcity-20329104-1754977235-190-n4cpu32-0001 teamcity-20329104-1754977235-190-n4cpu32-0002 teamcity-20329104-1754977235-190-n4cpu32-0003
stdout:
stderr: Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-d/instances/teamcity-20329104-1754977235-190-n4cpu32-0002].
Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-d/instances/teamcity-20329104-1754977235-190-n4cpu32-0003].
WARNING: Some requests generated warnings:
- Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
- The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2204-jammy-v20240319' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2204-jammy-v20250805'.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
---
code: ZONE_RESOURCE_POOL_EXHAUSTED_WITH_DETAILS
errorDetails:
- help:
links:
- description: Troubleshooting documentation
url: https://cloud.google.com/compute/docs/resource-error
- localizedMessage:
locale: en-US
message: A n2-custom-32-65536 VM instance with 4 local SSD(s) is currently unavailable
in the us-east1-d zone. Consider trying your request in the us-east1-c, us-east1-b
zone(s), which currently has capacity to accommodate your request. Alternatively,
you can try your request again with a different VM hardware configuration or
at a later time. For more information, see the troubleshooting documentation.
- errorInfo:
domain: compute.googleapis.com
metadatas:
attachment: local-ssd:4
vmType: n2-custom-32-65536
zone: us-east1-d
zonesAvailable: us-east1-c,us-east1-b
reason: resource_availability
message: The zone 'projects/cockroach-ephemeral/zones/us-east1-d' does not have enough
resources available to fulfill the request. '(resource type:compute)'.: exit status 1 [owner=test-eng]
```
Parameters:
- cloud=gce
- coverageBuild=false
- cpu=32
- runtimeAssertionsBuild=false
- ssd=0
Help
See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)
See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)
Same failure on other branches
- #151724 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.3]
- #151723 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.3]
- #151722 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.3]
- #151721 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.3]
- #151720 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.3]
- #151719 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.3]
- #151718 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.3]
- #151717 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.3]
- #151715 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.3]
- #151716 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.3]
/cc @cockroachdb/test-eng
[This test on roachdash](https://roachdash.crdb.dev/?filter=status:open%20t:.*cluster_creation.*&sort=title+created&display=lastcommented+project) | [Improve this report!](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/bazci/githubpost/issues)
Jira issue: CRDB-53448
Contributor guide
Assessment
This issue has not been assessed yet.