cockroachdb / cockroachdb/cockroach
Sentry: conn_executor.go:1133: panic: × (1) attached stack trace -- stack trace: | github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn.func1 | pkg/sql/conn_executor.go:1133 | [...re...
- Dominant language
- Go
- Stars
- 32.5k
- Forks
- 4.1k
- PR merge metrics
- PR metrics pending
Description
This issue was auto filed by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.
Sentry Link: [https://cockroach-labs.sentry.io/issues/7610657535/?referrer=webhooks_plugin](https://cockroach-labs.sentry.io/issues/7610657535/?referrer=webhooks_plugin)
Panic Message:
```
conn_executor.go:1133: panic: ×
(1) attached stack trace
-- stack trace:
| github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn.func1
| pkg/sql/conn_executor.go:1133
| [...repeated from below...]
Wraps: (2) plan gist: AgICAgYC
Wraps: (3) while executing: SELECT crdb_internal.force_panic(_)
Wraps: (4) attached stack trace
-- stack trace:
| github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn.func1
| pkg/sql/conn_executor.go:1133
| runtime.gopanic
| GOROOT/src/runtime/panic.go:783
| github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError.func1
| pkg/sql/colexecerror/error.go:137
| runtime.gopanic
| GOROOT/src/runtime/panic.go:783
| github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError.func1
| pkg/sql/colexecerror/error.go:137
| runtime.gopanic
| GOROOT/src/runtime/panic.go:783
| github.com/cockroachdb/cockroach/pkg/sql/colexecerror.NonCatchablePanic
| pkg/sql/colexecerror/error.go:317
| github.com/cockroachdb/cockroach/pkg/sql/sem/builtins.init.func293
| pkg/sql/sem/builtins/builtins.go:6201
| github.com/cockroachdb/cockroach/pkg/sql/sem/eval.(*evaluator).EvalFuncExpr
| pkg/sql/sem/eval/expr.go:502
| github.com/cockroachdb/cockroach/pkg/sql/sem/tree.(*FuncExpr).Eval
| bazel-out/k8-opt/bin/pkg/sql/sem/tree/eval_expr_generated.go:291
| github.com/cockroachdb/cockroach/pkg/sql/sem/eval.Expr
| pkg/sql/sem/eval/expr.go:22
| github.com/cockroachdb/cockroach/pkg/sql.(*valuesNode).startExec
| pkg/sql/values.go:86
| github.com/cockroachdb/cockroach/pkg/sql.startExec
| pkg/sql/plan.go:558
| github.com/cockroachdb/cockroach/pkg/sql.(*planNodeToRowSource).Start
| pkg/sql/plan_node_to_row_source.go:209
| github.com/cockroachdb/cockroach/pkg/sql/colexec.(*Columnarizer).Init
| pkg/sql/colexec/columnarizer.go:171
| github.com/cockroachdb/cockroach/pkg/sql/colflow.(*batchInfoCollector).init
| pkg/sql/colflow/stats.go:98
| github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError
| pkg/sql/colexecerror/error.go:162
| github.com/cockroachdb/cockroach/pkg/sql/colflow.(*batchInfoCollector).Init
| pkg/sql/colflow/stats.go:107
| github.com/cockroachdb/cockroach/pkg/sql/colflow.(*BatchFlowCoordinator).Run.(*BatchFlowCoordinator).init.func2
| pkg/sql/colflow/flow_coordinator.go:239
| github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError
| pkg/sql/colexecerror/error.go:162
| github.com/cockroachdb/cockroach/pkg/sql/colflow.(*BatchFlowCoordinator).init
| pkg/sql/colflow/flow_coordinator.go:238
| github.com/cockroachdb/cockroach/pkg/sql/colflow.(*BatchFlowCoordinator).Run
| pkg/sql/colflow/flow_coordinator.go:294
| github.com/cockroachdb/cockroach/pkg/sql/colflow.(*vectorizedFlow).Run
| pkg/sql/colflow/vectorized_flow.go:317
| github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).Run
| pkg/sql/distsql_running.go:1087
| github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRun
| pkg/sql/distsql_running.go:2397
| github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRunAll.func3
| pkg/sql/distsql_running.go:2096
| github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRunAll
| pkg/sql/distsql_running.go:2099
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execWithDistSQLEngine
| pkg/sql/conn_executor_exec.go:3653
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).dispatchToExecutionEngine
| pkg/sql/conn_executor_exec.go:3137
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmtInOpenState
| pkg/sql/conn_executor_exec.go:1122
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmt.func2
| pkg/sql/conn_executor_exec.go:183
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execWithProfiling
| pkg/sql/conn_executor_exec.go:4725
Wraps: (5) panic: ×
Error types: (1) *withstack.withStack (2) *safedetails.withSafeDetails (3) *safedetails.withSafeDetails (4) *withstack.withStack (5) *errutil.leafError
-- report composition:
*errutil.leafError: panic: ×
conn_executor.go:1133: *withstack.withStack (top exception)
*safedetails.withSafeDetails: while executing: SELECT crdb_internal.force_panic(_)
*safedetails.withSafeDetails: plan gist: AgICAgYC
conn_executor.go:1133: *withstack.withStack (1)
(check the extra data payloads)
```
Stacktrace (expand for inline code snippets):
[pkg/sql/conn_executor_exec.go#L4724-L4726](pkg/sql/conn_executor_exec.go#L4724-L4726)
[pkg/sql/conn_executor_exec.go#L182-L184](pkg/sql/conn_executor_exec.go#L182-L184)
[pkg/sql/conn_executor_exec.go#L1121-L1123](pkg/sql/conn_executor_exec.go#L1121-L1123)
[pkg/sql/conn_executor_exec.go#L3136-L3138](pkg/sql/conn_executor_exec.go#L3136-L3138)
[pkg/sql/conn_executor_exec.go#L3652-L3654](pkg/sql/conn_executor_exec.go#L3652-L3654)
[pkg/sql/distsql_running.go#L2098-L2100](pkg/sql/distsql_running.go#L2098-L2100)
[pkg/sql/distsql_running.go#L2095-L2097](pkg/sql/distsql_running.go#L2095-L2097)
[pkg/sql/distsql_running.go#L2396-L2398](pkg/sql/distsql_running.go#L2396-L2398)
[pkg/sql/distsql_running.go#L1086-L1088](pkg/sql/distsql_running.go#L1086-L1088)
[pkg/sql/colflow/vectorized_flow.go#L316-L318](pkg/sql/colflow/vectorized_flow.go#L316-L318)
[pkg/sql/colflow/flow_coordinator.go#L293-L295](pkg/sql/colflow/flow_coordinator.go#L293-L295)
[pkg/sql/colflow/flow_coordinator.go#L237-L239](pkg/sql/colflow/flow_coordinator.go#L237-L239)
[pkg/sql/colexecerror/error.go#L161-L163](pkg/sql/colexecerror/error.go#L161-L163)
[pkg/sql/colflow/flow_coordinator.go#L238-L240](pkg/sql/colflow/flow_coordinator.go#L238-L240)
[pkg/sql/colflow/stats.go#L106-L108](pkg/sql/colflow/stats.go#L106-L108)
[pkg/sql/colexecerror/error.go#L161-L163](pkg/sql/colexecerror/error.go#L161-L163)
[pkg/sql/colflow/stats.go#L97-L99](pkg/sql/colflow/stats.go#L97-L99)
[pkg/sql/colexec/columnarizer.go#L170-L172](pkg/sql/colexec/columnarizer.go#L170-L172)
[pkg/sql/plan_node_to_row_source.go#L208-L210](pkg/sql/plan_node_to_row_source.go#L208-L210)
[pkg/sql/plan.go#L557-L559](pkg/sql/plan.go#L557-L559)
[pkg/sql/values.go#L85-L87](pkg/sql/values.go#L85-L87)
[pkg/sql/sem/eval/expr.go#L21-L23](pkg/sql/sem/eval/expr.go#L21-L23)
[bazel-out/k8-opt/bin/pkg/sql/sem/tree/eval_expr_generated.go#L290-L292](bazel-out/k8-opt/bin/pkg/sql/sem/tree/eval_expr_generated.go#L290-L292)
[pkg/sql/sem/eval/expr.go#L501-L503](pkg/sql/sem/eval/expr.go#L501-L503)
[pkg/sql/sem/builtins/builtins.go#L6200-L6202](pkg/sql/sem/builtins/builtins.go#L6200-L6202)
[pkg/sql/colexecerror/error.go#L316-L318](pkg/sql/colexecerror/error.go#L316-L318)
[GOROOT/src/runtime/panic.go#L782-L784](GOROOT/src/runtime/panic.go#L782-L784)
[pkg/sql/colexecerror/error.go#L136-L138](pkg/sql/colexecerror/error.go#L136-L138)
[GOROOT/src/runtime/panic.go#L782-L784](GOROOT/src/runtime/panic.go#L782-L784)
[pkg/sql/colexecerror/error.go#L136-L138](pkg/sql/colexecerror/error.go#L136-L138)
[GOROOT/src/runtime/panic.go#L782-L784](GOROOT/src/runtime/panic.go#L782-L784)
[pkg/sql/conn_executor.go#L1132-L1134](pkg/sql/conn_executor.go#L1132-L1134)
```
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execWithProfiling at line 4725
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execStmt.func2 at line 183
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execStmtInOpenState at line 1122
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).dispatchToExecutionEngine at line 3137
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execWithDistSQLEngine at line 3653
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).PlanAndRunAll at line 2099
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).PlanAndRunAll.func3 at line 2096
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).PlanAndRun at line 2397
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).Run at line 1087
pkg/sql/colflow/vectorized_flow.go in pkg/sql/colflow.(*vectorizedFlow).Run at line 317
pkg/sql/colflow/flow_coordinator.go in pkg/sql/colflow.(*BatchFlowCoordinator).Run at line 294
pkg/sql/colflow/flow_coordinator.go in pkg/sql/colflow.(*BatchFlowCoordinator).init at line 238
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError at line 162
pkg/sql/colflow/flow_coordinator.go in pkg/sql/colflow.(*BatchFlowCoordinator).Run.(*BatchFlowCoordinator).init.func2 at line 239
pkg/sql/colflow/stats.go in pkg/sql/colflow.(*batchInfoCollector).Init at line 107
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError at line 162
pkg/sql/colflow/stats.go in pkg/sql/colflow.(*batchInfoCollector).init at line 98
pkg/sql/colexec/columnarizer.go in pkg/sql/colexec.(*Columnarizer).Init at line 171
pkg/sql/plan_node_to_row_source.go in pkg/sql.(*planNodeToRowSource).Start at line 209
pkg/sql/plan.go in pkg/sql.startExec at line 558
pkg/sql/values.go in pkg/sql.(*valuesNode).startExec at line 86
pkg/sql/sem/eval/expr.go in pkg/sql/sem/eval.Expr at line 22
bazel-out/k8-opt/bin/pkg/sql/sem/tree/eval_expr_generated.go in pkg/sql/sem/tree.(*FuncExpr).Eval at line 291
pkg/sql/sem/eval/expr.go in pkg/sql/sem/eval.(*evaluator).EvalFuncExpr at line 502
pkg/sql/sem/builtins/builtins.go in pkg/sql/sem/builtins.init.func293 at line 6201
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.NonCatchablePanic at line 317
GOROOT/src/runtime/panic.go in runtime.gopanic at line 783
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError.func1 at line 137
GOROOT/src/runtime/panic.go in runtime.gopanic at line 783
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError.func1 at line 137
GOROOT/src/runtime/panic.go in runtime.gopanic at line 783
pkg/sql/conn_executor.go in pkg/sql.(*Server).ServeConn.func1 at line 1133
```
### Tags
| Tag | Value |
| --- | --- |
| Command | demo |
| Environment | v26.2.4 |
| Go Version | go1.25.5 |
| Platform | linux amd64 |
| Distribution | CCL |
| Cockroach Release | v26.2.4 |
| Cockroach SHA | 80586181eb50e380e2cc982f61841eaf38af9982 |
| # of CPUs | 4 |
| # of Goroutines | 395 |
Jira issue: CRDB-65772
Contributor guide
Research direction
Start with pkg/sql/sem/builtins/builtins.go around line 6201 and the execution path through pkg/sql/colexecerror/error.go and pkg/sql/conn_executor.go. Reproduce the reported SELECT crdb_internal.force_panic(_) case on v26.2.4, then determine the intended behavior and add a focused regression test; the issue does not specify what change should be considered done.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go, sql
- Domain
- databases
- Issue type
- Bug
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100