cockroachdb / cockroachdb/cockroach

roachtest: cluster_creation failed

Open
#152,954 143 comments 0 reactions 0 assignees View on GitHub
branch-release-25.3.2-rc O-roachtest O-robot T-testeng X-infra-flake
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

roachtest.cluster_creation [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyAwsBazel/20428020?buildTab=log) with [artifacts](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestNightlyAwsBazel/20428020?buildTab=artifacts#/kv0/enc=false/nodes=3/mt-shared-process) on release-25.3.2-rc @ [5ff18332fb7814533293c56ee336451624e7a5d7](https://github.com/cockroachdb/cockroach/commits/5ff18332fb7814533293c56ee336451624e7a5d7):

```
test kv0/enc=false/nodes=3/mt-shared-process failed: (test_runner.go:850).func4: in provider: aws: failed to run: aws ec2 describe-instances --region us-east-2 --instance-ids i-007324d940df3da01 --output json: stderr:
An error occurred (InvalidInstanceID.NotFound) when calling the DescribeInstances operation: The instance ID 'i-007324d940df3da01' does not exist: exit status 254 [owner=test-eng]
```

Parameters:
- cloud=aws
- coverageBuild=false
- cpu=8
- runtimeAssertionsBuild=false
- ssd=0
Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #152953 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.2.6-rc]
- #152952 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-24.3.20-rc]
- #152844 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.3]
- #152504 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.3]
- #152503 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.3]
- #152502 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.3]
- #152501 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.3]
- #151853 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.3.1-rc]
- #151736 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-24.3.19-rc]
- #151734 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-25.2]

/cc @cockroachdb/test-eng

[This test on roachdash](https://roachdash.crdb.dev/?filter=status:open%20t:.*cluster_creation.*&sort=title+created&display=lastcommented+project) | [Improve this report!](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/bazci/githubpost/issues)

Jira issue: CRDB-54124

Contributor guide

Open the contributing guide

Research direction

Start with the TeamCity failure log and artifacts, then read pkg/cmd/roachtest/README.md for the roachtest workflow. Compare the repeated cluster_creation failures listed in this issue and inspect the roachdash results. Done means the cause of the missing AWS instance is identified and cluster_creation no longer produces this failure in a verified run.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, go
Domain
cloud, infrastructure, testing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.