cockroachdb / cockroachdb/cockroach

Sentry: conn_executor.go:1036: panic: × (1) attached stack trace -- stack trace: | github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn.func1 | pkg/sql/conn_executor.go:1036 | [...re...

Open
#172,521 0 comments 0 reactions 0 assignees View on GitHub
branch-release-25.2 C-bug O-sentry
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

This issue was auto filed by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.

Sentry Link: [https://cockroach-labs.sentry.io/issues/7610632161/?referrer=webhooks_plugin](https://cockroach-labs.sentry.io/issues/7610632161/?referrer=webhooks_plugin)

Panic Message:

```
conn_executor.go:1036: panic: ×
(1) attached stack trace
-- stack trace:
| github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn.func1
| pkg/sql/conn_executor.go:1036
| [...repeated from below...]
Wraps: (2) while executing: SELECT crdb_internal.force_panic(_)
Wraps: (3) attached stack trace
-- stack trace:
| github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn.func1
| pkg/sql/conn_executor.go:1036
| runtime.gopanic
| GOROOT/src/runtime/panic.go:791
| github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError.func1
| pkg/sql/colexecerror/error.go:137
| runtime.gopanic
| GOROOT/src/runtime/panic.go:791
| github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError.func1
| pkg/sql/colexecerror/error.go:137
| runtime.gopanic
| GOROOT/src/runtime/panic.go:791
| github.com/cockroachdb/cockroach/pkg/sql/colexecerror.NonCatchablePanic
| pkg/sql/colexecerror/error.go:317
| github.com/cockroachdb/cockroach/pkg/sql/sem/builtins.init.func275
| pkg/sql/sem/builtins/builtins.go:5942
| github.com/cockroachdb/cockroach/pkg/sql/sem/eval.(*evaluator).EvalFuncExpr
| pkg/sql/sem/eval/expr.go:503
| github.com/cockroachdb/cockroach/pkg/sql/sem/tree.(*FuncExpr).Eval
| bazel-out/k8-opt/bin/pkg/sql/sem/tree/eval_expr_generated.go:287
| github.com/cockroachdb/cockroach/pkg/sql/sem/eval.Expr
| pkg/sql/sem/eval/expr.go:21
| github.com/cockroachdb/cockroach/pkg/sql.(*valuesNode).startExec
| pkg/sql/values.go:86
| github.com/cockroachdb/cockroach/pkg/sql.startExec
| pkg/sql/plan.go:589
| github.com/cockroachdb/cockroach/pkg/sql.(*planNodeToRowSource).Start
| pkg/sql/plan_node_to_row_source.go:181
| github.com/cockroachdb/cockroach/pkg/sql/colexec.(*Columnarizer).Init
| pkg/sql/colexec/columnarizer.go:178
| github.com/cockroachdb/cockroach/pkg/sql/colflow.(*batchInfoCollector).init
| pkg/sql/colflow/stats.go:96
| github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError
| pkg/sql/colexecerror/error.go:162
| github.com/cockroachdb/cockroach/pkg/sql/colflow.(*batchInfoCollector).Init
| pkg/sql/colflow/stats.go:105
| github.com/cockroachdb/cockroach/pkg/sql/colflow.(*BatchFlowCoordinator).Run.(*BatchFlowCoordinator).init.func2
| pkg/sql/colflow/flow_coordinator.go:236
| github.com/cockroachdb/cockroach/pkg/sql/colexecerror.CatchVectorizedRuntimeError
| pkg/sql/colexecerror/error.go:162
| github.com/cockroachdb/cockroach/pkg/sql/colflow.(*BatchFlowCoordinator).init
| pkg/sql/colflow/flow_coordinator.go:235
| github.com/cockroachdb/cockroach/pkg/sql/colflow.(*BatchFlowCoordinator).Run
| pkg/sql/colflow/flow_coordinator.go:269
| github.com/cockroachdb/cockroach/pkg/sql/colflow.(*vectorizedFlow).Run
| pkg/sql/colflow/vectorized_flow.go:316
| github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).Run
| pkg/sql/distsql_running.go:999
| github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRun
| pkg/sql/distsql_running.go:2107
| github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRunAll.func3
| pkg/sql/distsql_running.go:1808
| github.com/cockroachdb/cockroach/pkg/sql.(*DistSQLPlanner).PlanAndRunAll
| pkg/sql/distsql_running.go:1811
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execWithDistSQLEngine
| pkg/sql/conn_executor_exec.go:3538
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).dispatchToExecutionEngine
| pkg/sql/conn_executor_exec.go:3040
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmtInOpenState
| pkg/sql/conn_executor_exec.go:1087
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execStmt.func2
| pkg/sql/conn_executor_exec.go:172
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execWithProfiling
| pkg/sql/conn_executor_exec.go:4553
Wraps: (4) panic: ×
Error types: (1) *withstack.withStack (2) *safedetails.withSafeDetails (3) *withstack.withStack (4) *errutil.leafError
-- report composition:
*errutil.leafError: panic: ×
conn_executor.go:1036: *withstack.withStack (top exception)
*safedetails.withSafeDetails: while executing: SELECT crdb_internal.force_panic(_)
conn_executor.go:1036: *withstack.withStack (1)
(check the extra data payloads)
```

Stacktrace (expand for inline code snippets):

[pkg/sql/conn_executor_exec.go#L4552-L4554](pkg/sql/conn_executor_exec.go#L4552-L4554)
[pkg/sql/conn_executor_exec.go#L171-L173](pkg/sql/conn_executor_exec.go#L171-L173)
[pkg/sql/conn_executor_exec.go#L1086-L1088](pkg/sql/conn_executor_exec.go#L1086-L1088)
[pkg/sql/conn_executor_exec.go#L3039-L3041](pkg/sql/conn_executor_exec.go#L3039-L3041)
[pkg/sql/conn_executor_exec.go#L3537-L3539](pkg/sql/conn_executor_exec.go#L3537-L3539)
[pkg/sql/distsql_running.go#L1810-L1812](pkg/sql/distsql_running.go#L1810-L1812)
[pkg/sql/distsql_running.go#L1807-L1809](pkg/sql/distsql_running.go#L1807-L1809)
[pkg/sql/distsql_running.go#L2106-L2108](pkg/sql/distsql_running.go#L2106-L2108)
[pkg/sql/distsql_running.go#L998-L1000](pkg/sql/distsql_running.go#L998-L1000)
[pkg/sql/colflow/vectorized_flow.go#L315-L317](pkg/sql/colflow/vectorized_flow.go#L315-L317)
[pkg/sql/colflow/flow_coordinator.go#L268-L270](pkg/sql/colflow/flow_coordinator.go#L268-L270)
[pkg/sql/colflow/flow_coordinator.go#L234-L236](pkg/sql/colflow/flow_coordinator.go#L234-L236)
[pkg/sql/colexecerror/error.go#L161-L163](pkg/sql/colexecerror/error.go#L161-L163)
[pkg/sql/colflow/flow_coordinator.go#L235-L237](pkg/sql/colflow/flow_coordinator.go#L235-L237)
[pkg/sql/colflow/stats.go#L104-L106](pkg/sql/colflow/stats.go#L104-L106)
[pkg/sql/colexecerror/error.go#L161-L163](pkg/sql/colexecerror/error.go#L161-L163)
[pkg/sql/colflow/stats.go#L95-L97](pkg/sql/colflow/stats.go#L95-L97)
[pkg/sql/colexec/columnarizer.go#L177-L179](pkg/sql/colexec/columnarizer.go#L177-L179)
[pkg/sql/plan_node_to_row_source.go#L180-L182](pkg/sql/plan_node_to_row_source.go#L180-L182)
[pkg/sql/plan.go#L588-L590](pkg/sql/plan.go#L588-L590)
[pkg/sql/values.go#L85-L87](pkg/sql/values.go#L85-L87)
[pkg/sql/sem/eval/expr.go#L20-L22](pkg/sql/sem/eval/expr.go#L20-L22)
[bazel-out/k8-opt/bin/pkg/sql/sem/tree/eval_expr_generated.go#L286-L288](bazel-out/k8-opt/bin/pkg/sql/sem/tree/eval_expr_generated.go#L286-L288)
[pkg/sql/sem/eval/expr.go#L502-L504](pkg/sql/sem/eval/expr.go#L502-L504)
[pkg/sql/sem/builtins/builtins.go#L5941-L5943](pkg/sql/sem/builtins/builtins.go#L5941-L5943)
[pkg/sql/colexecerror/error.go#L316-L318](pkg/sql/colexecerror/error.go#L316-L318)
[GOROOT/src/runtime/panic.go#L790-L792](GOROOT/src/runtime/panic.go#L790-L792)
[pkg/sql/colexecerror/error.go#L136-L138](pkg/sql/colexecerror/error.go#L136-L138)
[GOROOT/src/runtime/panic.go#L790-L792](GOROOT/src/runtime/panic.go#L790-L792)
[pkg/sql/colexecerror/error.go#L136-L138](pkg/sql/colexecerror/error.go#L136-L138)
[GOROOT/src/runtime/panic.go#L790-L792](GOROOT/src/runtime/panic.go#L790-L792)
[pkg/sql/conn_executor.go#L1035-L1037](pkg/sql/conn_executor.go#L1035-L1037)

```
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execWithProfiling at line 4553
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execStmt.func2 at line 172
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execStmtInOpenState at line 1087
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).dispatchToExecutionEngine at line 3040
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execWithDistSQLEngine at line 3538
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).PlanAndRunAll at line 1811
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).PlanAndRunAll.func3 at line 1808
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).PlanAndRun at line 2107
pkg/sql/distsql_running.go in pkg/sql.(*DistSQLPlanner).Run at line 999
pkg/sql/colflow/vectorized_flow.go in pkg/sql/colflow.(*vectorizedFlow).Run at line 316
pkg/sql/colflow/flow_coordinator.go in pkg/sql/colflow.(*BatchFlowCoordinator).Run at line 269
pkg/sql/colflow/flow_coordinator.go in pkg/sql/colflow.(*BatchFlowCoordinator).init at line 235
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError at line 162
pkg/sql/colflow/flow_coordinator.go in pkg/sql/colflow.(*BatchFlowCoordinator).Run.(*BatchFlowCoordinator).init.func2 at line 236
pkg/sql/colflow/stats.go in pkg/sql/colflow.(*batchInfoCollector).Init at line 105
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError at line 162
pkg/sql/colflow/stats.go in pkg/sql/colflow.(*batchInfoCollector).init at line 96
pkg/sql/colexec/columnarizer.go in pkg/sql/colexec.(*Columnarizer).Init at line 178
pkg/sql/plan_node_to_row_source.go in pkg/sql.(*planNodeToRowSource).Start at line 181
pkg/sql/plan.go in pkg/sql.startExec at line 589
pkg/sql/values.go in pkg/sql.(*valuesNode).startExec at line 86
pkg/sql/sem/eval/expr.go in pkg/sql/sem/eval.Expr at line 21
bazel-out/k8-opt/bin/pkg/sql/sem/tree/eval_expr_generated.go in pkg/sql/sem/tree.(*FuncExpr).Eval at line 287
pkg/sql/sem/eval/expr.go in pkg/sql/sem/eval.(*evaluator).EvalFuncExpr at line 503
pkg/sql/sem/builtins/builtins.go in pkg/sql/sem/builtins.init.func275 at line 5942
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.NonCatchablePanic at line 317
GOROOT/src/runtime/panic.go in runtime.gopanic at line 791
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError.func1 at line 137
GOROOT/src/runtime/panic.go in runtime.gopanic at line 791
pkg/sql/colexecerror/error.go in pkg/sql/colexecerror.CatchVectorizedRuntimeError.func1 at line 137
GOROOT/src/runtime/panic.go in runtime.gopanic at line 791
pkg/sql/conn_executor.go in pkg/sql.(*Server).ServeConn.func1 at line 1036
```

### Tags

| Tag | Value |
| --- | --- |
| Command | demo |
| Environment | v25.2.21 |
| Go Version | go1.23.12 X:nocoverageredesign |
| Platform | linux amd64 |
| Distribution | CCL |
| Cockroach Release | v25.2.21 |
| Cockroach SHA | 3b4bfa8d28783dc0a388147caa9eb7cc4b8d1e42 |
| # of CPUs | 4 |
| # of Goroutines | 407 |

Jira issue: CRDB-65769

Contributor guide

Open the contributing guide

Research direction

Start by reproducing the reported SELECT crdb_internal.force_panic(_) query and trace the execution through pkg/sql/sem/builtins/builtins.go, pkg/sql/colexecerror/error.go, and pkg/sql/conn_executor.go. Compare the intentional panic path with the surrounding vectorized execution and error-catching behavior; completion is undefined until the expected behavior for this report is established.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
backend, databases
Issue type
Bug
Difficulty
5/5
Estimated time
Over a week
Activity status
Quiet
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.