cockroachdb / cockroachdb/cockroach

roachtest: schema_change_workload_failure failed

Open
#174,228 17 comments 0 reactions 1 assignee Claimed by @shghasemi View on GitHub
branch-master C-test-failure O-roachtest O-robot P-2 T-sql-foundations
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

roachtest.schema_change_workload_failure [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_Roachtests_RoachtestNightlyGcePrivateBazel/21489845?buildTab=log) with [artifacts](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_Roachtests_RoachtestNightlyGcePrivateBazel/21489845?buildTab=artifacts#/c2c/kv0) on master @ [02a784a02b271268112a76ba3b96721caa0ac06a](https://github.com/cockroachdb/cockroach/commits/02a784a02b271268112a76ba3b96721caa0ac06a):

Failed with:

```
test c2c/kv0 failed: (monitor.go:329).Wait: monitor failure: schema change workload failed: full command output in run_074720.858619351_n7_workload-run-schemac.log: COMMAND_PROBLEM: exit status 1 [owner=sql-foundations]
(monitor.go:329).Wait: monitor failure: monitor user task failed: t.Fatal() was called
test artifacts and logs in: /artifacts/c2c/kv0/run_1
```
Cluster Node to Ip Mapping:
| Node | Public IP | Private IP |
| --- | --- | --- |
| teamcity-21489845-1787895274-34-n7cpu8-0001 | | 10.91.96.240 |
| teamcity-21489845-1787895274-34-n7cpu8-0002 | | 10.91.96.235 |
| teamcity-21489845-1787895274-34-n7cpu8-0003 | | 10.91.96.165 |
| teamcity-21489845-1787895274-34-n7cpu8-0004 | | 10.91.96.118 |
| teamcity-21489845-1787895274-34-n7cpu8-0005 | | 10.91.97.60 |
| teamcity-21489845-1787895274-34-n7cpu8-0006 | | 10.91.96.163 |
| teamcity-21489845-1787895274-34-n7cpu8-0007 | | 10.91.98.69 |

Parameters:
- arch=amd64
- cloud=gce
- coverageBuild=false
- cpu=8
- diskCount=0
- encrypted=false
- fs=ext4
- localSSD=false
- metamorphicLeases=default
- runtimeAssertionsBuild=false
Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

See: [Grafana](https://go.crdb.dev/roachtest-grafana/teamcity-21489845/c2c-kv0/1787903096008/1787904124929)

See: [Datadog Logs](https://us5.datadoghq.com/logs?query=service%3Aroachtest+%40cluster%3Ateamcity-21489845-1787895274-34-n7cpu8&from_ts=1787903096008&to_ts=1787904124929&live=false&storage=flex_tier)

Same failure on other branches

- #173366 release-26.3: roachtest: schema_change_workload_failure failed [C-test-failure O-roachtest O-robot P-2 T-sql-foundations branch-release-26.3]
- #171761 release-26.2.3-rc: roachtest: schema_change_workload_failure failed [C-bug O-roachtest O-robot T-sql-queries branch-release-26.2.3-rc]

/cc @cockroachlabs/sql-foundations

[Improve this report!](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/bazci/githubpost/issues)

Jira issue: CRDB-67530

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.