cockroachdb / cockroachdb/cockroach
Sentry: conn_executor.go:1036: panic: × (1) attached stack trace -- stack trace: | github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn.func1 | pkg/sql/conn_executor.go:1036 | [...re...
- Dominant language
- Go
- Stars
- 32.5k
- Forks
- 4.1k
- PR merge metrics
- PR metrics pending
Description
This issue was auto filed by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.
Sentry Link: [https://cockroach-labs.sentry.io/issues/7610632161/?referrer=webhooks_plugin](https://cockroach-labs.sentry.io/issues/7610632161/?referrer=webhooks_plugin)
Panic Message:
```
conn_executor.go:1036: panic: ×
(1) attached stack trace
-- stack trace:
| github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn.func1
| pkg/sql/conn_executor.go:1036
| [...repeated from below...]
Wraps: (2) while executing: SELECT crdb_internal.force_panic(_)
Wraps: (3) attached stack trace
-- stack trace:
| github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn.func1
| pkg/sql/conn_executor.go:1036
| runtime.gopanic
| GOROOT/src/runtime/panic.go:791
| github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError.func1
| pkg/sql/colexecerror/error.go:137
| runtime.gopanic
| GOROOT/src/runtime/panic.go:791
| github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError.func1
| pkg/sql/colexecerror/error.go:137
| runtime.gopanic
| GOROOT/src/runtime/panic.go:791
| github.com/cockroachdb/cockroach/pkg/sql/colexecerror.NonCatchablePanic
| pkg/sql/colexecerror/error.go:317
| github.com/cockroachdb/cockroach/pkg/sql/sem/builtins.init.func275
| pkg/sql/sem/builtins/builtins.go:5942
| github.com/cockroachdb/cockroach/pkg/sql/sem/eval.(*evaluator).EvalFuncExpr
| pkg/sql/sem/eval/expr.go:503
| github.com/cockroachdb/cockroach/pkg/sql/sem/tree.(*FuncExpr).Eval
| bazel-out/k8-opt/bin/pkg/sql/sem/tree/eval_expr_generated.go:287
| github.com/cockroachdb/cockroach/pkg/sql/sem/eval.Expr
| pkg/sql/sem/eval/expr.go:21
| github.com/cockroachdb/cockroach/pkg/sql.(*valuesNode).startExec
| pkg/sql/values.go:86
| github.com/cockroachdb/cockroach/pkg/sql.startExec
| pkg/sql/plan.go:589
| github.com/cockroachdb/cockroach/pkg/sql.(*planNodeToRowSource).Start
| pkg/sql/plan_node_to_row_source.go:181
| github.com/cockroachdb/cockroach/pkg/sql/colexec.(*Columnarizer).Init
| pkg/sql/colexec/columnarizer.go:178
| github.com/cockroachdb/cockroach/pkg/sql/colflow.(*batchInfoCollector).init
| pkg/sql/colflow/stats.go:96
| github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError
| pkg/sql/colexecerror/error.go:162
| github.com/cockroachdb/cockroach/pkg/sql/colflow.(*batchInfoCollector).Init
| pkg/sql/colflow/stats.go:105
| github.com/cockroachdb/cockroach/pkg/sql/colflow.(*BatchFlowCoordinator).Run.(*BatchFlowCoordinator).init.func2
| pkg/sql/colflow/flow_coordinator.go:236
| github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError
| pkg/sql/colexecerror/error.go:162
| github.com/cockroachdb/cockroach/pkg/sql/colflow.(*BatchFlowCoordinator).init
| pkg/sql/colflow/flow_coordinator.go:235
| github.com/cockroachdb/cockroach/pkg/sql/colflow.(*BatchFlowCoordinator).Run
| pkg/sql/colflow/flow_coordinator.go:269
| github.com/cockroachdb/cockroach/pkg/sql/colflow.(*vectorizedFlow).Run
| pkg/sql/colflow/vectorized_flow.go:316
| github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).Run
| pkg/sql/distsql_running.go:999
| github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRun
| pkg/sql/distsql_running.go:2107
| github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRunAll.func3
| pkg/sql/distsql_running.go:1808
| github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRunAll
| pkg/sql/distsql_running.go:1811
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execWithDistSQLEngine
| pkg/sql/conn_executor_exec.go:3538
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).dispatchToExecutionEngine
| pkg/sql/conn_executor_exec.go:3040
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmtInOpenState
| pkg/sql/conn_executor_exec.go:1087
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmt.func2
| pkg/sql/conn_executor_exec.go:172
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execWithProfiling
| pkg/sql/conn_executor_exec.go:4553
Wraps: (4) panic: ×
Error types: (1) *withstack.withStack (2) *safedetails.withSafeDetails (3) *withstack.withStack (4) *errutil.leafError
-- report composition:
*errutil.leafError: panic: ×
conn_executor.go:1036: *withstack.withStack (top exception)
*safedetails.withSafeDetails: while executing: SELECT crdb_internal.force_panic(_)
conn_executor.go:1036: *withstack.withStack (1)
(check the extra data payloads)
```
Stacktrace (expand for inline code snippets):
[pkg/sql/conn_executor_exec.go#L4552-L4554](pkg/sql/conn_executor_exec.go#L4552-L4554)
[pkg/sql/conn_executor_exec.go#L171-L173](pkg/sql/conn_executor_exec.go#L171-L173)
[pkg/sql/conn_executor_exec.go#L1086-L1088](pkg/sql/conn_executor_exec.go#L1086-L1088)
[pkg/sql/conn_executor_exec.go#L3039-L3041](pkg/sql/conn_executor_exec.go#L3039-L3041)
[pkg/sql/conn_executor_exec.go#L3537-L3539](pkg/sql/conn_executor_exec.go#L3537-L3539)
[pkg/sql/distsql_running.go#L1810-L1812](pkg/sql/distsql_running.go#L1810-L1812)
[pkg/sql/distsql_running.go#L1807-L1809](pkg/sql/distsql_running.go#L1807-L1809)
[pkg/sql/distsql_running.go#L2106-L2108](pkg/sql/distsql_running.go#L2106-L2108)
[pkg/sql/distsql_running.go#L998-L1000](pkg/sql/distsql_running.go#L998-L1000)
[pkg/sql/colflow/vectorized_flow.go#L315-L317](pkg/sql/colflow/vectorized_flow.go#L315-L317)
[pkg/sql/colflow/flow_coordinator.go#L268-L270](pkg/sql/colflow/flow_coordinator.go#L268-L270)
[pkg/sql/colflow/flow_coordinator.go#L234-L236](pkg/sql/colflow/flow_coordinator.go#L234-L236)
[pkg/sql/colexecerror/error.go#L161-L163](pkg/sql/colexecerror/error.go#L161-L163)
[pkg/sql/colflow/flow_coordinator.go#L235-L237](pkg/sql/colflow/flow_coordinator.go#L235-L237)
[pkg/sql/colflow/stats.go#L104-L106](pkg/sql/colflow/stats.go#L104-L106)
[pkg/sql/colexecerror/error.go#L161-L163](pkg/sql/colexecerror/error.go#L161-L163)
[pkg/sql/colflow/stats.go#L95-L97](pkg/sql/colflow/stats.go#L95-L97)
[pkg/sql/colexec/columnarizer.go#L177-L179](pkg/sql/colexec/columnarizer.go#L177-L179)
[pkg/sql/plan_node_to_row_source.go#L180-L182](pkg/sql/plan_node_to_row_source.go#L180-L182)
[pkg/sql/plan.go#L588-L590](pkg/sql/plan.go#L588-L590)
[pkg/sql/values.go#L85-L87](pkg/sql/values.go#L85-L87)
[pkg/sql/sem/eval/expr.go#L20-L22](pkg/sql/sem/eval/expr.go#L20-L22)
[bazel-out/k8-opt/bin/pkg/sql/sem/tree/eval_expr_generated.go#L286-L288](bazel-out/k8-opt/bin/pkg/sql/sem/tree/eval_expr_generated.go#L286-L288)
[pkg/sql/sem/eval/expr.go#L502-L504](pkg/sql/sem/eval/expr.go#L502-L504)
[pkg/sql/sem/builtins/builtins.go#L5941-L5943](pkg/sql/sem/builtins/builtins.go#L5941-L5943)
[pkg/sql/colexecerror/error.go#L316-L318](pkg/sql/colexecerror/error.go#L316-L318)
[GOROOT/src/runtime/panic.go#L790-L792](GOROOT/src/runtime/panic.go#L790-L792)
[pkg/sql/colexecerror/error.go#L136-L138](pkg/sql/colexecerror/error.go#L136-L138)
[GOROOT/src/runtime/panic.go#L790-L792](GOROOT/src/runtime/panic.go#L790-L792)
[pkg/sql/colexecerror/error.go#L136-L138](pkg/sql/colexecerror/error.go#L136-L138)
[GOROOT/src/runtime/panic.go#L790-L792](GOROOT/src/runtime/panic.go#L790-L792)
[pkg/sql/conn_executor.go#L1035-L1037](pkg/sql/conn_executor.go#L1035-L1037)
```
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execWithProfiling at line 4553
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execStmt.func2 at line 172
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execStmtInOpenState at line 1087
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).dispatchToExecutionEngine at line 3040
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execWithDistSQLEngine at line 3538
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).PlanAndRunAll at line 1811
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).PlanAndRunAll.func3 at line 1808
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).PlanAndRun at line 2107
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).Run at line 999
pkg/sql/colflow/vectorized_flow.go in pkg/sql/colflow.(*vectorizedFlow).Run at line 316
pkg/sql/colflow/flow_coordinator.go in pkg/sql/colflow.(*BatchFlowCoordinator).Run at line 269
pkg/sql/colflow/flow_coordinator.go in pkg/sql/colflow.(*BatchFlowCoordinator).init at line 235
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError at line 162
pkg/sql/colflow/flow_coordinator.go in pkg/sql/colflow.(*BatchFlowCoordinator).Run.(*BatchFlowCoordinator).init.func2 at line 236
pkg/sql/colflow/stats.go in pkg/sql/colflow.(*batchInfoCollector).Init at line 105
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError at line 162
pkg/sql/colflow/stats.go in pkg/sql/colflow.(*batchInfoCollector).init at line 96
pkg/sql/colexec/columnarizer.go in pkg/sql/colexec.(*Columnarizer).Init at line 178
pkg/sql/plan_node_to_row_source.go in pkg/sql.(*planNodeToRowSource).Start at line 181
pkg/sql/plan.go in pkg/sql.startExec at line 589
pkg/sql/values.go in pkg/sql.(*valuesNode).startExec at line 86
pkg/sql/sem/eval/expr.go in pkg/sql/sem/eval.Expr at line 21
bazel-out/k8-opt/bin/pkg/sql/sem/tree/eval_expr_generated.go in pkg/sql/sem/tree.(*FuncExpr).Eval at line 287
pkg/sql/sem/eval/expr.go in pkg/sql/sem/eval.(*evaluator).EvalFuncExpr at line 503
pkg/sql/sem/builtins/builtins.go in pkg/sql/sem/builtins.init.func275 at line 5942
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.NonCatchablePanic at line 317
GOROOT/src/runtime/panic.go in runtime.gopanic at line 791
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError.func1 at line 137
GOROOT/src/runtime/panic.go in runtime.gopanic at line 791
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError.func1 at line 137
GOROOT/src/runtime/panic.go in runtime.gopanic at line 791
pkg/sql/conn_executor.go in pkg/sql.(*Server).ServeConn.func1 at line 1036
```
### Tags
| Tag | Value |
| --- | --- |
| Command | demo |
| Environment | v25.2.21 |
| Go Version | go1.23.12 X:nocoverageredesign |
| Platform | linux amd64 |
| Distribution | CCL |
| Cockroach Release | v25.2.21 |
| Cockroach SHA | 3b4bfa8d28783dc0a388147caa9eb7cc4b8d1e42 |
| # of CPUs | 4 |
| # of Goroutines | 407 |
Jira issue: CRDB-65769
Contributor guide
Research direction
Start by reproducing the reported SELECT crdb_internal.force_panic(_) query and trace the execution through pkg/sql/sem/builtins/builtins.go, pkg/sql/colexecerror/error.go, and pkg/sql/conn_executor.go. Compare the intentional panic path with the surrounding vectorized execution and error-catching behavior; completion is undefined until the expected behavior for this report is established.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go
- Domain
- backend, databases
- Issue type
- Bug
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Quiet
- Clarity
- Needs clarification
- Newbie friendliness
- 20/100