cockroachdb / cockroachdb/cockroach
Sentry: cmd_recover_txn.go:134: non-atomic COPY couldn't roll back its txn: failed indeterminate commit recovery: programming error: timestamp change by implicitly committed transaction: 1772733534.87...
- Dominant language
- Go
- Stars
- 32.5k
- Forks
- 4.1k
- PR merge metrics
- PR metrics pending
Description
This issue was auto filed by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.
Sentry Link: [https://cockroach-labs.sentry.io/issues/7313036656/?referrer=webhooks_plugin](https://cockroach-labs.sentry.io/issues/7313036656/?referrer=webhooks_plugin)
Panic Message:
```
cmd_recover_txn.go:134: non-atomic COPY couldn't roll back its txn: failed indeterminate commit recovery: programming error: timestamp change by implicitly committed transaction: 1772733534.879202087,2->1772733531.502718832,0
(1) attached stack trace
-- stack trace:
| github.com/cockroachdb/cockroach/pkg/sql.(*planner).preparePlannerForCopy.func1
| pkg/sql/copy_from.go:1094
| github.com/cockroachdb/cockroach/pkg/sql.(*copyMachine).insertRowsInternal.func1
| pkg/sql/copy_from.go:1198
| github.com/cockroachdb/cockroach/pkg/sql.(*copyMachine).insertRowsInternal
| pkg/sql/copy_from.go:1268
| github.com/cockroachdb/cockroach/pkg/sql.(*copyMachine).insertRows
| pkg/sql/copy_from.go:1151
| github.com/cockroachdb/cockroach/pkg/sql.(*copyMachine).processCopyData
| pkg/sql/copy_from.go:722
| github.com/cockroachdb/cockroach/pkg/sql.(*copyMachine).run
| pkg/sql/copy_from.go:632
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCopyIn.func9
| pkg/sql/conn_executor.go:3507
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execWithProfiling
| pkg/sql/conn_executor_exec.go:4553
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCopyIn
| pkg/sql/conn_executor.go:3494
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).execCmd
| pkg/sql/conn_executor.go:2651
| github.com/cockroachdb/cockroach/pkg/sql.(*connExecutor).run
| pkg/sql/conn_executor.go:2378
| github.com/cockroachdb/cockroach/pkg/sql.(*Server).ServeConn
| pkg/sql/conn_executor.go:1038
| github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*conn).processCommands
| pkg/sql/pgwire/conn.go:252
| github.com/cockroachdb/cockroach/pkg/sql/pgwire.(*Server).serveImpl.func4
| pkg/sql/pgwire/server.go:1201
| runtime.goexit
| src/runtime/asm_amd64.s:1700
Wraps: (2) non-atomic COPY couldn't roll back its txn
Wraps: (3)
| (opaque error wrapper)
| type name: github.com/cockroachdb/errors/withstack/*withstack.withStack
| reportable 0:
|
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/txnrecovery.(*manager).ResolveIndeterminateCommit
| pkg/kv/kvserver/txnrecovery/manager.go:105
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).handleIndeterminateCommitError
| pkg/kv/kvserver/replica_send.go:782
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
| pkg/kv/kvserver/replica_send.go:554
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).SendWithWriteBytes
| pkg/kv/kvserver/replica_send.go:177
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).SendWithWriteBytes
| pkg/kv/kvserver/store_send.go:188
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).SendWithWriteBytes
| pkg/kv/kvserver/stores.go:203
| github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
| pkg/server/node.go:1647
| github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
| pkg/server/node.go:1840
| github.com/cockroachdb/cockroach/pkg/server.(*Node).batchStreamImpl
| pkg/server/node.go:1895
| github.com/cockroachdb/cockroach/pkg/server.(*Node).BatchStream
| pkg/server/node.go:1866
| github.com/cockroachdb/cockroach/pkg/kv/kvpb._Internal_BatchStream_Handler
| bazel-out/k8-opt/bin/pkg/kv/kvpb/kvpb_go_proto_/github.com/cockroachdb/cockroach/pkg/kv/kvpb/api.pb.go:10861
| github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.StreamServerInterceptor.func13
| pkg/util/tracing/grpcinterceptor/grpc_interceptor.go:143
| google.golang.org/grpc.getChainStreamHandler.func1
| external/org_golang_google_grpc/server.go:1504
| github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.func4
| pkg/rpc/context.go:181
| google.golang.org/grpc.getChainStreamHandler.func1
| external/org_golang_google_grpc/server.go:1504
| github.com/cockroachdb/cockroach/pkg/rpc.kvAuth.streamInterceptor
| pkg/rpc/auth.go:152
| google.golang.org/grpc.getChainStreamHandler.func1
| external/org_golang_google_grpc/server.go:1504
| github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.func2.1
| pkg/rpc/context.go:142
| github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
| pkg/util/stop/stopper.go:350
| github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.func2
| pkg/rpc/context.go:141
| google.golang.org/grpc.NewServer.chainStreamServerInterceptors.chainStreamInterceptors.func2
| external/org_golang_google_grpc/server.go:1495
| google.golang.org/grpc.(*Server).processStreamingRPC
| external/org_golang_google_grpc/server.go:1659
| google.golang.org/grpc.(*Server).handleStream
| external/org_golang_google_grpc/server.go:1739
| google.golang.org/grpc.(*Server).serveStreams.func1.1
| external/org_golang_google_grpc/server.go:970
| runtime.goexit
| src/runtime/asm_amd64.s:1700
Wraps: (4) failed indeterminate commit recovery
Wraps: (5) assertion failure
Wraps: (6)
| (opaque error wrapper)
| type name: github.com/cockroachdb/errors/withstack/*withstack.withStack
| reportable 0:
|
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/batcheval.RecoverTxn
| pkg/kv/kvserver/batcheval/cmd_recover_txn.go:134
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.evaluateCommand
| pkg/kv/kvserver/replica_evaluate.go:539
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.evaluateBatch
| pkg/kv/kvserver/replica_evaluate.go:355
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evaluateWriteBatchWrapper
| pkg/kv/kvserver/replica_write.go:751
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evaluateWriteBatchWithServersideRefreshes
| pkg/kv/kvserver/replica_write.go:716
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evaluateWriteBatch
| pkg/kv/kvserver/replica_write.go:479
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evaluateProposal
| pkg/kv/kvserver/replica_proposal.go:999
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).requestToProposal
| pkg/kv/kvserver/replica_proposal.go:1095
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).evalAndPropose
| pkg/kv/kvserver/replica_raft.go:116
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeWriteBatch
| pkg/kv/kvserver/replica_write.go:188
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
| pkg/kv/kvserver/replica_send.go:498
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).SendWithWriteBytes
| pkg/kv/kvserver/replica_send.go:177
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).SendWithWriteBytes
| pkg/kv/kvserver/store_send.go:188
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).SendWithWriteBytes
| pkg/kv/kvserver/stores.go:203
| github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
| pkg/server/node.go:1647
| github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
| pkg/server/node.go:1840
| github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.func1
| pkg/rpc/context.go:726
| github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.ServerInterceptor.func12
| pkg/util/tracing/grpcinterceptor/grpc_interceptor.go:96
| github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4
| pkg/rpc/context.go:837
| github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.func3
| pkg/rpc/context.go:172
| github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4
| pkg/rpc/context.go:837
| github.com/cockroachdb/cockroach/pkg/rpc.kvAuth.unaryInterceptor
| pkg/rpc/auth.go:90
| github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4
| pkg/rpc/context.go:837
| github.com/cockroachdb/cockroach/pkg/server.newGRPCServer.NewRequestMetricsInterceptor.func4
| pkg/rpc/metrics.go:386
| github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors...
```
Stacktrace (expand for inline code snippets):
[src/runtime/asm_amd64.s#L1699-L1701](src/runtime/asm_amd64.s#L1699-L1701)
[pkg/sql/pgwire/server.go#L1200-L1202](pkg/sql/pgwire/server.go#L1200-L1202)
[pkg/sql/pgwire/conn.go#L251-L253](pkg/sql/pgwire/conn.go#L251-L253)
[pkg/sql/conn_executor.go#L1037-L1039](pkg/sql/conn_executor.go#L1037-L1039)
[pkg/sql/conn_executor.go#L2377-L2379](pkg/sql/conn_executor.go#L2377-L2379)
[pkg/sql/conn_executor.go#L2650-L2652](pkg/sql/conn_executor.go#L2650-L2652)
[pkg/sql/conn_executor.go#L3493-L3495](pkg/sql/conn_executor.go#L3493-L3495)
[pkg/sql/conn_executor_exec.go#L4552-L4554](pkg/sql/conn_executor_exec.go#L4552-L4554)
[pkg/sql/conn_executor.go#L3506-L3508](pkg/sql/conn_executor.go#L3506-L3508)
[pkg/sql/copy_from.go#L631-L633](pkg/sql/copy_from.go#L631-L633)
[pkg/sql/copy_from.go#L721-L723](pkg/sql/copy_from.go#L721-L723)
[pkg/sql/copy_from.go#L1150-L1152](pkg/sql/copy_from.go#L1150-L1152)
[pkg/sql/copy_from.go#L1267-L1269](pkg/sql/copy_from.go#L1267-L1269)
[pkg/sql/copy_from.go#L1197-L1199](pkg/sql/copy_from.go#L1197-L1199)
[pkg/sql/copy_from.go#L1093-L1095](pkg/sql/copy_from.go#L1093-L1095)
[src/runtime/asm_amd64.s#L1699-L1701](src/runtime/asm_amd64.s#L1699-L1701)
[external/org_golang_google_grpc/server.go#L969-L971](external/org_golang_google_grpc/server.go#L969-L971)
[external/org_golang_google_grpc/server.go#L1738-L1740](external/org_golang_google_grpc/server.go#L1738-L1740)
[external/org_golang_google_grpc/server.go#L1658-L1660](external/org_golang_google_grpc/server.go#L1658-L1660)
[external/org_golang_google_grpc/server.go#L1494-L1496](external/org_golang_google_grpc/server.go#L1494-L1496)
[pkg/rpc/context.go#L140-L142](pkg/rpc/context.go#L140-L142)
[pkg/util/stop/stopper.go#L349-L351](pkg/util/stop/stopper.go#L349-L351)
[pkg/rpc/context.go#L141-L143](pkg/rpc/context.go#L141-L143)
[external/org_golang_google_grpc/server.go#L1503-L1505](external/org_golang_google_grpc/server.go#L1503-L1505)
[pkg/rpc/auth.go#L151-L153](pkg/rpc/auth.go#L151-L153)
[external/org_golang_google_grpc/server.go#L1503-L1505](external/org_golang_google_grpc/server.go#L1503-L1505)
[pkg/rpc/context.go#L180-L182](pkg/rpc/context.go#L180-L182)
[external/org_golang_google_grpc/server.go#L1503-L1505](external/org_golang_google_grpc/server.go#L1503-L1505)
[pkg/util/tracing/grpcinterceptor/grpc_interceptor.go#L142-L144](pkg/util/tracing/grpcinterceptor/grpc_interceptor.go#L142-L144)
[bazel-out/k8-opt/bin/pkg/kv/kvpb/kvpb_go_proto_/https://github.com/cockroachdb/cockroach/blob/a2cf0e12d277179df853e7e494c0155a6839edf3/pkg/kv/kvpb/api.pb.go#L10860-L10862](bazel-out/k8-opt/bin/pkg/kv/kvpb/kvpb_go_proto_/https://github.com/cockroachdb/cockroach/blob/a2cf0e12d277179df853e7e494c0155a6839edf3/pkg/kv/kvpb/api.pb.go#L10860-L10862)
[pkg/server/node.go#L1865-L1867](pkg/server/node.go#L1865-L1867)
[pkg/server/node.go#L1894-L1896](pkg/server/node.go#L1894-L1896)
[pkg/server/node.go#L1839-L1841](pkg/server/node.go#L1839-L1841)
[pkg/server/node.go#L1646-L1648](pkg/server/node.go#L1646-L1648)
[pkg/kv/kvserver/stores.go#L202-L204](pkg/kv/kvserver/stores.go#L202-L204)
[pkg/kv/kvserver/store_send.go#L187-L189](pkg/kv/kvserver/store_send.go#L187-L189)
[pkg/kv/kvserver/replica_send.go#L176-L178](pkg/kv/kvserver/replica_send.go#L176-L178)
[pkg/kv/kvserver/replica_send.go#L553-L555](pkg/kv/kvserver/replica_send.go#L553-L555)
[pkg/kv/kvserver/replica_send.go#L781-L783](pkg/kv/kvserver/replica_send.go#L781-L783)
[pkg/kv/kvserver/txnrecovery/manager.go#L104-L106](pkg/kv/kvserver/txnrecovery/manager.go#L104-L106)
[pkg/rpc/context.go#L920-L922](pkg/rpc/context.go#L920-L922)
[pkg/util/tracing/grpcinterceptor/grpc_interceptor.go#L235-L237](pkg/util/tracing/grpcinterceptor/grpc_interceptor.go#L235-L237)
[pkg/rpc/context.go#L735-L737](pkg/rpc/context.go#L735-L737)
[pkg/rpc/context.go#L836-L838](pkg/rpc/context.go#L836-L838)
[pkg/rpc/context.go#L130-L132](pkg/rpc/context.go#L130-L132)
[pkg/util/stop/stopper.go#L349-L351](pkg/util/stop/stopper.go#L349-L351)
[pkg/rpc/context.go#L132-L134](pkg/rpc/context.go#L132-L134)
[pkg/rpc/context.go#L836-L838](pkg/rpc/context.go#L836-L838)
[pkg/rpc/metrics.go#L385-L387](pkg/rpc/metrics.go#L385-L387)
[pkg/rpc/context.go#L836-L838](pkg/rpc/context.go#L836-L838)
[pkg/rpc/auth.go#L89-L91](pkg/rpc/auth.go#L89-L91)
[pkg/rpc/context.go#L836-L838](pkg/rpc/context.go#L836-L838)
[pkg/rpc/context.go#L171-L173](pkg/rpc/context.go#L171-L173)
[pkg/rpc/context.go#L836-L838](pkg/rpc/context.go#L836-L838)
[pkg/util/tracing/grpcinterceptor/grpc_interceptor.go#L95-L97](pkg/util/tracing/grpcinterceptor/grpc_interceptor.go#L95-L97)
[pkg/rpc/context.go#L725-L727](pkg/rpc/context.go#L725-L727)
[pkg/server/node.go#L1839-L1841](pkg/server/node.go#L1839-L1841)
[pkg/server/node.go#L1646-L1648](pkg/server/node.go#L1646-L1648)
[pkg/kv/kvserver/stores.go#L202-L204](pkg/kv/kvserver/stores.go#L202-L204)
[pkg/kv/kvserver/store_send.go#L187-L189](pkg/kv/kvserver/store_send.go#L187-L189)
[pkg/kv/kvserver/replica_send.go#L176-L178](pkg/kv/kvserver/replica_send.go#L176-L178)
[pkg/kv/kvserver/replica_send.go#L497-L499](pkg/kv/kvserver/replica_send.go#L497-L499)
[pkg/kv/kvserver/replica_write.go#L187-L189](pkg/kv/kvserver/replica_write.go#L187-L189)
[pkg/kv/kvserver/replica_raft.go#L115-L117](pkg/kv/kvserver/replica_raft.go#L115-L117)
[pkg/kv/kvserver/replica_proposal.go#L1094-L1096](pkg/kv/kvserver/replica_proposal.go#L1094-L1096)
[pkg/kv/kvserver/replica_proposal.go#L998-L1000](pkg/kv/kvserver/replica_proposal.go#L998-L1000)
[pkg/kv/kvserver/replica_write.go#L478-L480](pkg/kv/kvserver/replica_write.go#L478-L480)
[pkg/kv/kvserver/replica_write.go#L715-L717](pkg/kv/kvserver/replica_write.go#L715-L717)
[pkg/kv/kvserver/replica_write.go#L750-L752](pkg/kv/kvserver/replica_write.go#L750-L752)
[pkg/kv/kvserver/replica_evaluate.go#L354-L356](pkg/kv/kvserver/replica_evaluate.go#L354-L356)
[pkg/kv/kvserver/replica_evaluate.go#L538-L540](pkg/kv/kvserver/replica_evaluate.go#L538-L540)
[pkg/kv/kvserver/batcheval/cmd_recover_txn.go#L133-L135](pkg/kv/kvserver/batcheval/cmd_recover_txn.go#L133-L135)
```
src/runtime/asm_amd64.s in runtime.goexit at line 1700
pkg/sql/pgwire/server.go in pkg/sql/pgwire.(*Server).serveImpl.func4 at line 1201
pkg/sql/pgwire/conn.go in pkg/sql/pgwire.(*conn).processCommands at line 252
pkg/sql/conn_executor.go in pkg/sql.(*Server).ServeConn at line 1038
pkg/sql/conn_executor.go in pkg/sql.(*connExecutor).run at line 2378
pkg/sql/conn_executor.go in pkg/sql.(*connExecutor).execCmd at line 2651
pkg/sql/conn_executor.go in pkg/sql.(*connExecutor).execCopyIn at line 3494
pkg/sql/conn_executor_exec.go in pkg/sql.(*connExecutor).execWithProfiling at line 4553
pkg/sql/conn_executor.go in pkg/sql.(*connExecutor).execCopyIn.func9 at line 3507
pkg/sql/copy_from.go in pkg/sql.(*copyMachine).run at line 632
pkg/sql/copy_from.go in pkg/sql.(*copyMachine).processCopyData at line 722
pkg/sql/copy_from.go in pkg/sql.(*copyMachine).insertRows at line 1151
pkg/sql/copy_from.go in pkg/sql.(*copyMachine).insertRowsInternal at line 1268
pkg/sql/copy_from.go in pkg/sql.(*copyMachine).insertRowsInternal.func1 at line 1198
pkg/sql/copy_from.go in pkg/sql.(*planner).preparePlannerForCopy.func1 at line 1094
src/runtime/asm_amd64.s in runtime.goexit at line 1700
external/org_golang_google_grpc/server.go in google.golang.org/grpc.(*Server).serveStreams.func1.1 at line 970
external/org_golang_google_grpc/server.go in google.golang.org/grpc.(*Server).handleStream at line 1739
external/org_golang_google_grpc/server.go in google.golang.org/grpc.(*Server).processStreamingRPC at line 1659
external/org_golang_google_grpc/server.go in google.golang.org/grpc.NewServer.chainStreamServerInterceptors.chainStreamInterceptors.func2 at line 1495
pkg/rpc/context.go in pkg/rpc.NewServerEx.func2 at line 141
pkg/util/stop/stopper.go in pkg/util/stop.(*Stopper).RunTaskWithErr at line 350
pkg/rpc/context.go in pkg/rpc.NewServerEx.func2.1 at line 142
external/org_golang_google_grpc/server.go in google.golang.org/grpc.getChainStreamHandler.func1 at line 1504
pkg/rpc/auth.go in pkg/rpc.kvAuth.streamInterceptor at line 152
external/org_golang_google_grpc/server.go in google.golang.org/grpc.getChainStreamHandler.func1 at line 1504
pkg/rpc/context.go in pkg/rpc.NewServerEx.func4 at line 181
external/org_golang_google_grpc/server.go in google.golang.org/grpc.getChainStreamHandler.func1 at line 1504
pkg/util/tracing/grpcinterceptor/grpc_interceptor.go in pkg/rpc.NewServerEx.StreamServerInterceptor.func13 at line 143
bazel-out/k8-opt/bin/pkg/kv/kvpb/kvpb_go_proto_/github.com/cockroachdb/cockroach/pkg/kv/kvpb/api.pb.go in pkg/kv/kvpb._Internal_BatchStream_Handler at line 10861
pkg/server/node.go in pkg/server.(*Node).BatchStream at line 1866
pkg/server/node.go in pkg/server.(*Node).batchStreamImpl at line 1895
pkg/server/node.go in pkg/server.(*Node).Batch at line 1840
pkg/server/node.go in pkg/server.(*Node).batchInternal at line 1647
pkg/kv/kvserver/stores.go in pkg/kv/kvserver.(*Stores).SendWithWriteBytes at line 203
pkg/kv/kvserver/store_send.go in pkg/kv/kvserver.(*Store).SendWithWriteBytes at line 188
pkg/kv/kvserver/replica_send.go in pkg/kv/kvserver.(*Replica).SendWithWriteBytes at line 177
pkg/kv/kvserver/replica_send.go in pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries at line 554
pkg/kv/kvserver/replica_send.go in pkg/kv/kvserver.(*Replica).handleIndeterminateCommitError at line 782
pkg/kv/kvserver/txnrecovery/manager.go in pkg/kv/kvserver/txnrecovery.(*manager).ResolveIndeterminateCommit at line 105
pkg/rpc/context.go in pkg/rpc.getChainUnaryInvoker.func1 at line 921
pkg/util/tracing/grpcinterceptor/grpc_interceptor.go in pkg/rpc.NewContext.ClientInterceptor.func8 at line 236
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.func2 at line 736
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4 at line 837
pkg/rpc/context.go in pkg/rpc.NewServerEx.func1 at line 131
pkg/util/stop/stopper.go in pkg/util/stop.(*Stopper).RunTaskWithErr at line 350
pkg/rpc/context.go in pkg/rpc.NewServerEx.func1.1 at line 133
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4 at line 837
pkg/rpc/metrics.go in pkg/server.newGRPCServer.NewRequestMetricsInterceptor.func4 at line 386
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4 at line 837
pkg/rpc/auth.go in pkg/rpc.kvAuth.unaryInterceptor at line 90
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4 at line 837
pkg/rpc/context.go in pkg/rpc.NewServerEx.func3 at line 172
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4 at line 837
pkg/util/tracing/grpcinterceptor/grpc_interceptor.go in pkg/rpc.NewServerEx.ServerInterceptor.func12 at line 96
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.func1 at line 726
pkg/server/node.go in pkg/server.(*Node).Batch at line 1840
pkg/server/node.go in pkg/server.(*Node).batchInternal at line 1647
pkg/kv/kvserver/stores.go in pkg/kv/kvserver.(*Stores).SendWithWriteBytes at line 203
pkg/kv/kvserver/store_send.go in pkg/kv/kvserver.(*Store).SendWithWriteBytes at line 188
pkg/kv/kvserver/replica_send.go in pkg/kv/kvserver.(*Replica).SendWithWriteBytes at line 177
pkg/kv/kvserver/replica_send.go in pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries at line 498
pkg/kv/kvserver/replica_write.go in pkg/kv/kvserver.(*Replica).executeWriteBatch at line 188
pkg/kv/kvserver/replica_raft.go in pkg/kv/kvserver.(*Replica).evalAndPropose at line 116
pkg/kv/kvserver/replica_proposal.go in pkg/kv/kvserver.(*Replica).requestToProposal at line 1095
pkg/kv/kvserver/replica_proposal.go in pkg/kv/kvserver.(*Replica).evaluateProposal at line 999
pkg/kv/kvserver/replica_write.go in pkg/kv/kvserver.(*Replica).evaluateWriteBatch at line 479
pkg/kv/kvserver/replica_write.go in pkg/kv/kvserver.(*Replica).evaluateWriteBatchWithServersideRefreshes at line 716
pkg/kv/kvserver/replica_write.go in pkg/kv/kvserver.(*Replica).evaluateWriteBatchWrapper at line 751
pkg/kv/kvserver/replica_evaluate.go in pkg/kv/kvserver.evaluateBatch at line 355
pkg/kv/kvserver/replica_evaluate.go in pkg/kv/kvserver.evaluateCommand at line 539
pkg/kv/kvserver/batcheval/cmd_recover_txn.go in pkg/kv/kvserver/batcheval.RecoverTxn at line 134
```
### Tags
| Tag | Value |
| --- | --- |
| Command | server |
| Environment | v25.2.10 |
| Go Version | go1.23.12 X:nocoverageredesign |
| Platform | linux amd64 |
| Distribution | CCL |
| Cockroach Release | v25.2.10 |
| Cockroach SHA | a2cf0e12d277179df853e7e494c0155a6839edf3 |
| # of CPUs | 16 |
| # of Goroutines | 2152 |
Jira issue: CRDB-61085
Contributor guide
Assessment
This issue has not been assessed yet.