cockroachdb / cockroachdb/cockroach

roachtest: cluster_creation failed

Open
#146,719 5 comments 0 reactions 0 assignees View on GitHub
branch-release-24.1.19-rc O-roachtest O-robot T-testeng X-infra-flake
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

roachtest.cluster_creation [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyGceBazel/19685412?buildTab=log) with [artifacts](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyGceBazel/19685412?buildTab=artifacts#/follower-reads/survival=zone/locality=regional/reads=bounded-staleness) on release-24.1.19-rc @ [bebd9a7d30104773ff2b85d8af0785a1b2f00fab](https://github.com/cockroachdb/cockroach/commits/bebd9a7d30104773ff2b85d8af0785a1b2f00fab):

```
test follower-reads/survival=zone/locality=regional/reads=bounded-staleness failed: (test_runner.go:811).func4: in provider: gce: Command: gcloud [compute instances create --subnet default --labels spot=true,usage=roachtest,roachprod=true,cluster=teamcity-19685412-1747200905-67-n6cpu4-geo,lifetime=12h0m0s,arch=amd64,created=2025-05-14t09_47_09z --scopes cloud-platform --image ubuntu-2204-jammy-v20230727 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --provisioning-model SPOT --local-ssd interface=NVME --machine-type n2-standard-4 --min-cpu-platform Intel Ice Lake --metadata-from-file startup-script=/tmp/gce-startup-script3242769458 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west1-b teamcity-19685412-1747200905-67-n6cpu4-geo-0004 teamcity-19685412-1747200905-67-n6cpu4-geo-0005]
Output: WARNING: Some requests generated warnings:
- Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
- The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2204-jammy-v20230727' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2204-jammy-v20250508'.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
- Quota 'LOCAL_SSD_TOTAL_GB_PER_VM_FAMILY' exceeded. Limit: 30000.0 in region us-west1.
metric name = compute.googleapis.com/local_ssd_total_storage_per_vm_family
limit name = LOCAL-SSD-TOTAL-GB-PER-VM-FAMILY-per-project-region
limit = 30000.0
dimensions = region: us-west1
vm_family: N2
Try your request in another zone, or view documentation on how to increase quotas: https://cloud.google.com/compute/quotas.: exit status 1 [owner=test-eng]
```

Parameters:
- cloud=gce
- coverageBuild=false
- cpu=4
- runtimeAssertionsBuild=false
- ssd=0
Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #146718 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2.26-rc]
- #146616 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.1.7-rc]
- #146615 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-24.3.14-rc]
- #145942 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2]
- #145938 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.2.0-rc]
- #145937 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]
- #145521 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2.25-rc]
- #145022 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.1.6-rc]
- #145021 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-24.3.12-rc]
- #144454 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-24.1.17-rc]

/cc @cockroachdb/test-eng

[This test on roachdash](https://roachdash.crdb.dev/?filter=status:open%20t:.*cluster_creation.*&sort=title+created&display=lastcommented+project) | [Improve this report!](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/bazci/githubpost/issues)

Jira issue: CRDB-50675

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.