cockroachdb / cockroachdb/cockroach

roachtest: cluster_creation failed

Open
#155,672 64 comments 0 reactions 0 assignees View on GitHub
branch-release-25.4.0-rc O-roachtest O-robot T-testeng X-infra-flake
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

roachtest.cluster_creation [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyAwsBazel/20621187?buildTab=log) with [artifacts](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyAwsBazel/20621187?buildTab=artifacts#/kv0/enc=false/nodes=1) on release-25.4.0-rc @ [1de9c4bc217dca385a4f912dbdf828bc5629711a](https://github.com/cockroachdb/cockroach/commits/1de9c4bc217dca385a4f912dbdf828bc5629711a):

```
test kv0/enc=false/nodes=1 failed: (test_runner.go:873).func4: in provider: aws: failed to run: aws ec2 run-instances --associate-public-ip-address --count 1 --instance-type m7gd.2xlarge --image-id ami-05983a09f7dc1c18f --key-name teamcity-runner-D4togJZGkL_SHybJVt7XQDhrTpE= --region us-east-2 --security-group-ids sg-04d72b57e29d671f1 --subnet-id subnet-0258dc9d1b6473d84 --tag-specifications ResourceType=instance,Tags=[{Key=usage,Value=roachtest},{Key=roachtest-branch,Value=release-25-4-0-rc},{Key=cluster,Value=teamcity-20621187-1760767578-26-n2cpu8},{Key=lifetime,Value=12h0m0s},{Key=arch,Value=arm64},{Key=created,Value=2025-10-18T06:34:15Z},{Key=Name,Value=teamcity-20621187-1760767578-26-n2cpu8-0001},{Key=Cluster,Value=teamcity-20621187-1760767578-26-n2cpu8},{Key=spot,Value=true},{Key=roachprod,Value=true}] ResourceType=volume,Tags=[{Key=usage,Value=roachtest},{Key=roachtest-branch,Value=release-25-4-0-rc},{Key=cluster,Value=teamcity-20621187-1760767578-26-n2cpu8},{Key=lifetime,Value=12h0m0s},{Key=arch,Value=arm64},{Key=created,Value=2025-10-18T06:34:15Z},{Key=Name,Value=teamcity-20621187-1760767578-26-n2cpu8-0001},{Key=Cluster,Value=teamcity-20621187-1760767578-26-n2cpu8},{Key=spot,Value=true},{Key=roachprod,Value=true}] --user-data file:///tmp/aws-startup-script2226666137 --iam-instance-profile Name=roachprod-testing --block-device-mapping file:///tmp/aws-block-device-mapping3217083158 --instance-market-options MarketType=spot,SpotOptions={SpotInstanceType=one-time,InstanceInterruptionBehavior=terminate} --output json: stderr:
An error occurred (InsufficientInstanceCapacity) when calling the RunInstances operation (reached max retries: 2): There is no Spot capacity available that matches your request.: exit status 254 [owner=test-eng]
```

Parameters:
- cloud=aws
- coverageBuild=false
- cpu=8
- runtimeAssertionsBuild=false
- ssd=0
Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #155354 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.3]
- #155353 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.3]
- #155352 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]
- #154938 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.3]
- #154936 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.3]
- #154937 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.3]
- #154935 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.3]
- #154855 roachtest: cluster_creation failed [O-roachtest O-robot O-rsg T-testeng X-infra-flake branch-release-24.1.25-rc]
- #154726 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]
- #154725 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

/cc @cockroachdb/test-eng

[This test on roachdash](https://roachdash.crdb.dev/?filter=status:open%20t:.*cluster_creation.*&sort=title+created&display=lastcommented+project) | [Improve this report!](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/bazci/githubpost/issues)

Jira issue: CRDB-55534

Contributor guide

Open the contributing guide

Research direction

Start with the linked TeamCity log and artifacts, then read pkg/cmd/roachtest/README.md and compare the related cluster_creation reports listed in the issue. The payload does not identify a source file, test, or intended change, so clarify the scope and completion criteria before starting.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, go
Domain
cloud, infrastructure, testing
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
15/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.