cockroachdb / cockroachdb/cockroach
basalt-26.3.2-rc-20260914: pkg/ccl/testccl/workload/schemachange/schemachange_test: TestWorkloadMultiRegion failed
- Dominant language
- Go
- Stars
- 32.5k
- Forks
- 4.1k
- PR merge metrics
- PR metrics pending
Description
pkg/ccl/testccl/workload/schemachange/schemachange_test.TestWorkloadMultiRegion [failed](https://mesolite.cluster.engflow.com/invocations/default/08e1b277-b139-4a1b-a853-91899cf5a52c?testReportRun=9&testReportShard=2&testReportAttempt=1#targets-Ly9wa2cvY2NsL3Rlc3RjY2wvd29ya2xvYWQvc2NoZW1hY2hhbmdlOnNjaGVtYWNoYW5nZV90ZXN0) on basalt-26.3.2-rc-20260914 @ [d3eb08ebdd1dacc8d3dac0b107a7db5929e09969](https://github.com/cockroachdb/cockroach/commits/d3eb08ebdd1dacc8d3dac0b107a7db5929e09969):
```
| pkg/sql/opt/optbuilder/builder.go:319 +0x118
| github.com/cockroachdb/cockroach/pkg/sql/opt/optbuilder.(*Builder).Build(0x12097a2bd380)
| pkg/sql/opt/optbuilder/builder.go:298 +0x2e5
| github.com/cockroachdb/cockroach/pkg/sql.(*optPlanningCtx).buildExecMemo(0x120980899290, {0x813b4a0, 0x120998cb3680})
| pkg/sql/plan_opt.go:1077 +0x34c
| github.com/cockroachdb/cockroach/pkg/sql.(*planner).makeOptimizerPlanInternal(0x120980898180, {0x813b4a0, 0x120998cb3680})
| pkg/sql/plan_opt.go:365 +0x2e
| github.com/cockroachdb/cockroach/pkg/sql.(*planner).makeOptimizerPlan(0x120980898180, {0x813b4a0?, 0x120998cb35e0?})
| pkg/sql/plan_opt.go:345 +0x425
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).makeExecPlan(0x120980897908, {0x813b4a0, 0x120998cb35e0}, 0x120980898180)
| pkg/sql/conn_executor_exec.go:3596 +0x179
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).dispatchToExecutionEngine(0x120980897908, {0x813b4a0, 0x120998cb35e0}, 0x120980898180, {0x7f32eb533068, 0x12095be5e360})
| pkg/sql/conn_executor_exec.go:3145 +0xda5
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmtInOpenState(0x120980897908, {0x813a818?, 0x12097aa98690?}, {{0x816c2e0, 0x12097afd2c60}, {0x0, 0x0, 0x0}, {0x12099ac04000, 0x3f84}, ...}, ...)
| pkg/sql/conn_executor_exec.go:1161 +0x3b72
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmt.func2({0x813a818?, 0x12097aa98690?})
| pkg/sql/conn_executor_exec.go:185 +0xba
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execWithProfiling(0x120980897908, {0x813a818, 0x12097aa98690}, {0x816c2e0, 0x12097afd2c60}, 0x0, 0x120976627548)
| pkg/sql/conn_executor_exec.go:4978 +0x475
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmt(0x120980897908, {0x813a818, 0x12097aa98690}, {{0x816c2e0, 0x12097afd2c60}, {0x0, 0x0, 0x0}, {0x12099ac04000, 0x3f84}, ...}, ...)
| pkg/sql/conn_executor_exec.go:184 +0x885
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCmd.func1(...)
| pkg/sql/conn_executor.go:2701
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCmd(0x120980897908)
| pkg/sql/conn_executor.go:2706 +0x277c
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).run(0x120980897908, {0x813b4a0, 0x1209807c15e0}, 0x501aca?, 0x120981989190?, 0x12098040b7c0?)
| pkg/sql/conn_executor.go:2572 +0x1f7
| github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn(0x12095c8b37a0?, {0x813b4a0?, 0x1209807c15e0?}, {0x120980897908?, {0x0?, 0x0?, 0x120974f307e8?}}, 0x8?, 0x120981716480?)
| pkg/sql/conn_executor.go:1221 +0xea
| github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*conn).processCommands(0x12095be5dc08, {0x813b4a0, 0x1209807c15e0}, {0x0, 0x4, {0x1, {0x7c06219, 0x3}, {0x120980927e80, 0x18}, ...}, ...}, ...)
| pkg/sql/pgwire/conn.go:254 +0x535
| github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*Server).serveImpl.func4()
| pkg/sql/pgwire/server.go:1337 +0xf6
| created by github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*Server).serveImpl in goroutine 22820
| pkg/sql/pgwire/server.go:1334 +0x616
| : could not find enum value (SQLSTATE XXUUU)
Error types: (1) *markers.withMark (2) *schemachange.ErrorState (3) *withstack.withStack (4) *errutil.withPrefix (5) *pgconn.PgError
Test: TestWorkloadMultiRegion
Schema Workload Stats
Total Schema Statements Executed = 89
Total Schema Statements Succeeded = 89
Total Schema Statement Expected Failures = 0
Total Transactions Committed = 54
Total Transactions Rolled Back = 45
Total Transactions Executed = 99
schema_change_external_test.go:136: backup, tracing data, and system table dumps in /mnt/engflow/worker/work/0/exec/bazel-out/k8-fastbuild/testlogs/pkg/ccl/testccl/workload/schemachange/schemachange_test/shard_2_of_2_run_9_of_10/test.outputs/logTestWorkloadMultiRegion1581784554
schema_change_external_test.go:145: running DROP with use_declarative_schema_changer = off
panic.go:694: -- test log scope end --
test logs left over in: outputs.zip/logTestWorkloadMultiRegion1581784554
--- FAIL: TestWorkloadMultiRegion (74.05s)
```
Parameters:
- attempt=1
- run=9
- shard=2
Help
See also: [How To Investigate a Go Test Failure \(internal\)](https://cockroachlabs.atlassian.net/l/c/HgfXfJgM)
Same failure on other branches
- #173367 release-26.3: pkg/ccl/testccl/workload/schemachange/schemachange_test: TestWorkloadMultiRegion failed [C-test-failure O-robot P-2 T-sql-foundations branch-release-26.3]
/cc @cockroachlabs/sql-foundations
[This test on roachdash](https://roachdash.crdb.dev/?filter=status:open%20t:.*TestWorkloadMultiRegion.*&sort=title+created&display=lastcommented+project) | [Improve this report!](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/bazci/githubpost/issues)
Contributor guide
Research direction
Reproduce pkg/ccl/testccl/workload/schemachange/schemachange_test.TestWorkloadMultiRegion using the linked failure details and inspect the test logs in outputs.zip. Start at pkg/sql/opt/optbuilder/builder.go:319 and trace the reported "could not find enum value" error; done means the multi-region schema-change test passes without that error.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go, sql
- Domain
- databases, distributed-systems, testing-qa
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Active
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100