cockroachdb / cockroachdb/cockroach

roachtest: cluster_creation failed

Open
#159,031 243 comments 0 reactions 0 assignees View on GitHub
branch-release-25.2 O-roachtest O-robot T-testeng X-infra-flake
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

roachtest.cluster_creation [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyAwsBazel/20831319?buildTab=log) with [artifacts](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyAwsBazel/20831319?buildTab=artifacts#/ycsb/E/nodes=3/cpu=32) on release-25.2 @ [2b91553a89b7ad4f471352cd8881183601537a95](https://github.com/cockroachdb/cockroach/commits/2b91553a89b7ad4f471352cd8881183601537a95):

```
test ycsb/E/nodes=3/cpu=32 failed: (test_runner.go:840).func4: in provider: aws: failed to run: aws ec2 run-instances --associate-public-ip-address --count 1 --instance-type c6id.8xlarge --image-id ami-0e83be366243f524a --key-name teamcity-runner-pdFZfZC3SR2SzIC9duU-E6B2n8g= --region us-east-2 --security-group-ids sg-04d72b57e29d671f1 --subnet-id subnet-0258dc9d1b6473d84 --tag-specifications ResourceType=instance,Tags=[{Key=usage,Value=roachtest},{Key=roachtest-branch,Value=release-25-2},{Key=Cluster,Value=teamcity-20831319-1765262131-65-n4cpu32},{Key=spot,Value=true},{Key=roachprod,Value=true},{Key=cluster,Value=teamcity-20831319-1765262131-65-n4cpu32},{Key=lifetime,Value=12h0m0s},{Key=arch,Value=amd64},{Key=created,Value=2025-12-09T08:33:51Z},{Key=Name,Value=teamcity-20831319-1765262131-65-n4cpu32-0002}] ResourceType=volume,Tags=[{Key=usage,Value=roachtest},{Key=roachtest-branch,Value=release-25-2},{Key=Cluster,Value=teamcity-20831319-1765262131-65-n4cpu32},{Key=spot,Value=true},{Key=roachprod,Value=true},{Key=cluster,Value=teamcity-20831319-1765262131-65-n4cpu32},{Key=lifetime,Value=12h0m0s},{Key=arch,Value=amd64},{Key=created,Value=2025-12-09T08:33:51Z},{Key=Name,Value=teamcity-20831319-1765262131-65-n4cpu32-0002}] --user-data file:///tmp/aws-startup-script3745005122 --iam-instance-profile Name=roachprod-testing --block-device-mapping file:///tmp/aws-block-device-mapping3895798012 --instance-market-options MarketType=spot,SpotOptions={SpotInstanceType=one-time,InstanceInterruptionBehavior=terminate} --output json: stderr:
An error occurred (InsufficientInstanceCapacity) when calling the RunInstances operation (reached max retries: 2): There is no Spot capacity available that matches your request.: exit status 254 [owner=test-eng]
```

Parameters:
- cloud=aws
- coverageBuild=false
- cpu=32
- runtimeAssertionsBuild=false
- ssd=0
Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

/cc @cockroachdb/test-eng

[This test on roachdash](https://roachdash.crdb.dev/?filter=status:open%20t:.*cluster_creation.*&sort=title+created&display=lastcommented+project) | [Improve this report!](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/bazci/githubpost/issues)

Jira issue: CRDB-57619

Contributor guide

Open the contributing guide

Research direction

Start with the linked TeamCity build log and artifacts, then read pkg/cmd/roachtest/README.md and the cluster_creation roachtest entry point. Confirm how AWS Spot capacity failures are handled and review the 243-comment thread for any agreed direction. Done is not defined by the issue, so the expected behavior must be established before implementation.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, go
Domain
cloud, devops, testing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
12/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.