cockroachdb / cockroachdb/cockroach

roachtest: cluster_creation failed

Open
#173,187 1207 comments 0 reactions 0 assignees View on GitHub
branch-master O-roachtest O-robot T-testeng X-infra-flake
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

roachtest.cluster_creation [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_Roachtests_RoachtestNightlyIbmBazel/21455612?buildTab=log) with [artifacts](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_Roachtests_RoachtestNightlyIbmBazel/21455612?buildTab=artifacts#/drop/tpcc/w=100,nodes=9) on master @ [59751e8a0b65beb3c3423fbb4625ee9b06cec8d7](https://github.com/cockroachdb/cockroach/commits/59751e8a0b65beb3c3423fbb4625ee9b06cec8d7):

```
test drop/tpcc/w=100,nodes=9 failed: (test_runner.go:1364).func5: in provider: ibm: failed to create instance teamcity-21455612-1786078300-36-n9cpu4-0008 in region br-sao: instance teamcity-21455612-1786078300-36-n9cpu4-0008 didn't reach stable state in 4m30s; [instance state: starting|network attached: false]
failed to create instance teamcity-21455612-1786078300-36-n9cpu4-0007 in region br-sao: instance teamcity-21455612-1786078300-36-n9cpu4-0007 didn't reach stable state in 4m30s; [instance state: starting|network attached: false]
failed to create instance teamcity-21455612-1786078300-36-n9cpu4-0002 in region br-sao: instance teamcity-21455612-1786078300-36-n9cpu4-0002 didn't reach stable state in 4m30s; [instance state: starting|network attached: false]
failed to create instance teamcity-21455612-1786078300-36-n9cpu4-0005 in region br-sao: instance teamcity-21455612-1786078300-36-n9cpu4-0005 didn't reach stable state in 4m30s; [instance state: starting|network attached: false]
failed to create instance teamcity-21455612-1786078300-36-n9cpu4-0006 in region br-sao: instance teamcity-21455612-1786078300-36-n9cpu4-0006 didn't reach stable state in 4m30s; [instance state: starting|network attached: false]
failed to create instance teamcity-21455612-1786078300-36-n9cpu4-0003 in region br-sao: instance teamcity-21455612-1786078300-36-n9cpu4-0003 didn't reach stable state in 4m30s; [instance state: starting|network attached: false]
failed to create instance teamcity-21455612-1786078300-36-n9cpu4-0001 in region br-sao: instance teamcity-21455612-1786078300-36-n9cpu4-0001 didn't reach stable state in 4m30s; [instance state: starting|network attached: false]
failed to create instance teamcity-21455612-1786078300-36-n9cpu4-0004 in region br-sao: instance teamcity-21455612-1786078300-36-n9cpu4-0004 didn't reach stable state in 4m30s; [instance state: starting|network attached: false] [owner=test-eng]
```

Parameters:
- cloud=ibm
- coverageBuild=false
- cpu=4
- diskCount=0
- runtimeAssertionsBuild=false
Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

/cc @cockroachlabs/test-eng

[This test on roachdash](https://roachdash.crdb.dev/?filter=status:open%20t:.*cluster_creation.*&sort=title+created&display=lastcommented+project) | [Improve this report!](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/bazci/githubpost/issues)

Jira issue: CRDB-66511

Contributor guide

Open the contributing guide

Research direction

Start with pkg/cmd/roachtest/README.md and the failure path at test_runner.go:1364. Review the linked TeamCity log and artifacts for the IBM br-sao instance-creation failure, then use the roachdash entry to compare related cluster_creation failures. Done means the cause is addressed and the IBM cluster_creation test can create stable instances successfully.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
cloud, infrastructure, testing-qa
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.