cockroachdb / cockroachdb/cockroach

Sentry: panic.go:770: runtime error: invalid memory address or nil pointer dereference (1) attached stack trace -- stack trace: | runtime.gopanic | GOROOT/src/runtime/panic.go:770 | github.co...

Open
#164,713 1 comment 0 reactions 0 assignees View on GitHub
branch-release-24.3 C-bug O-sentry T-kv X-blathers-triaged
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

This issue was auto filed by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.

Sentry Link: [https://cockroach-labs.sentry.io/issues/7305069322/?referrer=webhooks_plugin](https://cockroach-labs.sentry.io/issues/7305069322/?referrer=webhooks_plugin)

Panic Message:

```
panic.go:770: runtime error: invalid memory address or nil pointer dereference
(1) attached stack trace
-- stack trace:
| runtime.gopanic
| GOROOT/src/runtime/panic.go:770
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).SendWithWriteBytes.func1
| pkg/kv/kvserver/store_send.go:104
| runtime.gopanic
| GOROOT/src/runtime/panic.go:770
| runtime.panicmem
| GOROOT/src/runtime/panic.go:261
| runtime.sigpanic
| GOROOT/src/runtime/signal_unix.go:881
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/lockspanset.(*LockSpanSet).Len
| pkg/kv/kvserver/lockspanset/lockspanset.go:87
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/lockspanset.(*LockSpanSet).Empty
| pkg/kv/kvserver/lockspanset/lockspanset.go:69
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency.(*managerImpl).sequenceReqWithGuard
| pkg/kv/kvserver/concurrency/concurrency_manager.go:316
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency.(*managerImpl).SequenceReq
| pkg/kv/kvserver/concurrency/concurrency_manager.go:239
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
| pkg/kv/kvserver/replica_send.go:453
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).SendWithWriteBytes
| pkg/kv/kvserver/replica_send.go:177
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).SendWithWriteBytes
| pkg/kv/kvserver/store_send.go:188
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).SendWithWriteBytes
| pkg/kv/kvserver/stores.go:197
| github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
| pkg/server/node.go:1636
| github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
| pkg/server/node.go:1837
| github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.func1
| pkg/rpc/context.go:713
| github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.ServerInterceptor.func12
| pkg/util/tracing/grpcinterceptor/grpc_interceptor.go:92
| github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4
| pkg/rpc/context.go:824
| github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.func3
| pkg/rpc/context.go:165
| github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4
| pkg/rpc/context.go:824
| github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.func1.1
| pkg/rpc/context.go:132
| github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
| pkg/util/stop/stopper.go:349
| github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.func1
| pkg/rpc/context.go:130
| github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4
| pkg/rpc/context.go:824
| github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.func2
| pkg/rpc/context.go:723
| github.com/cockroachdb/cockroach/pkg/rpc.NewContext.ClientInterceptor.func8
| pkg/util/tracing/grpcinterceptor/grpc_interceptor.go:223
| github.com/cockroachdb/cockroach/pkg/rpc.getChainUnaryInvoker.func1
| pkg/rpc/context.go:908
| github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.func3
| pkg/rpc/context.go:793
| github.com/cockroachdb/cockroach/pkg/rpc.internalClientAdapter.Batch
| pkg/rpc/context.go:916
| github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch
| pkg/kv/kvclient/kvcoord/transport.go:209
| github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext
| pkg/kv/kvclient/kvcoord/transport.go:187
| github.com/cockroachdb/cockroach/pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas
| pkg/kv/kvclient/kvcoord/dist_sender.go:2747
Wraps: (2) runtime error: invalid memory address or nil pointer dereference
Error types: (1) *withstack.withStack (2) runtime.errorString
-- report composition:
runtime.errorString
panic.go:770: *withstack.withStack (top exception)
```

Stacktrace (expand for inline code snippets):

[pkg/kv/kvclient/kvcoord/dist_sender.go#L2746-L2748](pkg/kv/kvclient/kvcoord/dist_sender.go#L2746-L2748)
[pkg/kv/kvclient/kvcoord/transport.go#L186-L188](pkg/kv/kvclient/kvcoord/transport.go#L186-L188)
[pkg/kv/kvclient/kvcoord/transport.go#L208-L210](pkg/kv/kvclient/kvcoord/transport.go#L208-L210)
[pkg/rpc/context.go#L915-L917](pkg/rpc/context.go#L915-L917)
[pkg/rpc/context.go#L792-L794](pkg/rpc/context.go#L792-L794)
[pkg/rpc/context.go#L907-L909](pkg/rpc/context.go#L907-L909)
[pkg/util/tracing/grpcinterceptor/grpc_interceptor.go#L222-L224](pkg/util/tracing/grpcinterceptor/grpc_interceptor.go#L222-L224)
[pkg/rpc/context.go#L722-L724](pkg/rpc/context.go#L722-L724)
[pkg/rpc/context.go#L823-L825](pkg/rpc/context.go#L823-L825)
[pkg/rpc/context.go#L129-L131](pkg/rpc/context.go#L129-L131)
[pkg/util/stop/stopper.go#L348-L350](pkg/util/stop/stopper.go#L348-L350)
[pkg/rpc/context.go#L131-L133](pkg/rpc/context.go#L131-L133)
[pkg/rpc/context.go#L823-L825](pkg/rpc/context.go#L823-L825)
[pkg/rpc/context.go#L164-L166](pkg/rpc/context.go#L164-L166)
[pkg/rpc/context.go#L823-L825](pkg/rpc/context.go#L823-L825)
[pkg/util/tracing/grpcinterceptor/grpc_interceptor.go#L91-L93](pkg/util/tracing/grpcinterceptor/grpc_interceptor.go#L91-L93)
[pkg/rpc/context.go#L712-L714](pkg/rpc/context.go#L712-L714)
[pkg/server/node.go#L1836-L1838](pkg/server/node.go#L1836-L1838)
[pkg/server/node.go#L1635-L1637](pkg/server/node.go#L1635-L1637)
[pkg/kv/kvserver/stores.go#L196-L198](pkg/kv/kvserver/stores.go#L196-L198)
[pkg/kv/kvserver/store_send.go#L187-L189](pkg/kv/kvserver/store_send.go#L187-L189)
[pkg/kv/kvserver/replica_send.go#L176-L178](pkg/kv/kvserver/replica_send.go#L176-L178)
[pkg/kv/kvserver/replica_send.go#L452-L454](pkg/kv/kvserver/replica_send.go#L452-L454)
[pkg/kv/kvserver/concurrency/concurrency_manager.go#L238-L240](pkg/kv/kvserver/concurrency/concurrency_manager.go#L238-L240)
[pkg/kv/kvserver/concurrency/concurrency_manager.go#L315-L317](pkg/kv/kvserver/concurrency/concurrency_manager.go#L315-L317)
[pkg/kv/kvserver/lockspanset/lockspanset.go#L68-L70](pkg/kv/kvserver/lockspanset/lockspanset.go#L68-L70)
[pkg/kv/kvserver/lockspanset/lockspanset.go#L86-L88](pkg/kv/kvserver/lockspanset/lockspanset.go#L86-L88)
[GOROOT/src/runtime/signal_unix.go#L880-L882](GOROOT/src/runtime/signal_unix.go#L880-L882)
[GOROOT/src/runtime/panic.go#L260-L262](GOROOT/src/runtime/panic.go#L260-L262)
[GOROOT/src/runtime/panic.go#L769-L771](GOROOT/src/runtime/panic.go#L769-L771)
[pkg/kv/kvserver/store_send.go#L103-L105](pkg/kv/kvserver/store_send.go#L103-L105)
[GOROOT/src/runtime/panic.go#L769-L771](GOROOT/src/runtime/panic.go#L769-L771)

```
pkg/kv/kvclient/kvcoord/dist_sender.go in pkg/kv/kvclient/kvcoord.(*DistSender).sendToReplicas at line 2747
pkg/kv/kvclient/kvcoord/transport.go in pkg/kv/kvclient/kvcoord.(*grpcTransport).SendNext at line 187
pkg/kv/kvclient/kvcoord/transport.go in pkg/kv/kvclient/kvcoord.(*grpcTransport).sendBatch at line 209
pkg/rpc/context.go in pkg/rpc.internalClientAdapter.Batch at line 916
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.func3 at line 793
pkg/rpc/context.go in pkg/rpc.getChainUnaryInvoker.func1 at line 908
pkg/util/tracing/grpcinterceptor/grpc_interceptor.go in pkg/rpc.NewContext.ClientInterceptor.func8 at line 223
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.func2 at line 723
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4 at line 824
pkg/rpc/context.go in pkg/rpc.NewServerEx.func1 at line 130
pkg/util/stop/stopper.go in pkg/util/stop.(*Stopper).RunTaskWithErr at line 349
pkg/rpc/context.go in pkg/rpc.NewServerEx.func1.1 at line 132
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4 at line 824
pkg/rpc/context.go in pkg/rpc.NewServerEx.func3 at line 165
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4 at line 824
pkg/util/tracing/grpcinterceptor/grpc_interceptor.go in pkg/rpc.NewServerEx.ServerInterceptor.func12 at line 92
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.func1 at line 713
pkg/server/node.go in pkg/server.(*Node).Batch at line 1837
pkg/server/node.go in pkg/server.(*Node).batchInternal at line 1636
pkg/kv/kvserver/stores.go in pkg/kv/kvserver.(*Stores).SendWithWriteBytes at line 197
pkg/kv/kvserver/store_send.go in pkg/kv/kvserver.(*Store).SendWithWriteBytes at line 188
pkg/kv/kvserver/replica_send.go in pkg/kv/kvserver.(*Replica).SendWithWriteBytes at line 177
pkg/kv/kvserver/replica_send.go in pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries at line 453
pkg/kv/kvserver/concurrency/concurrency_manager.go in pkg/kv/kvserver/concurrency.(*managerImpl).SequenceReq at line 239
pkg/kv/kvserver/concurrency/concurrency_manager.go in pkg/kv/kvserver/concurrency.(*managerImpl).sequenceReqWithGuard at line 316
pkg/kv/kvserver/lockspanset/lockspanset.go in pkg/kv/kvserver/lockspanset.(*LockSpanSet).Empty at line 69
pkg/kv/kvserver/lockspanset/lockspanset.go in pkg/kv/kvserver/lockspanset.(*LockSpanSet).Len at line 87
GOROOT/src/runtime/signal_unix.go in runtime.sigpanic at line 881
GOROOT/src/runtime/panic.go in runtime.panicmem at line 261
GOROOT/src/runtime/panic.go in runtime.gopanic at line 770
pkg/kv/kvserver/store_send.go in pkg/kv/kvserver.(*Store).SendWithWriteBytes.func1 at line 104
GOROOT/src/runtime/panic.go in runtime.gopanic at line 770
```

### Tags

| Tag | Value |
| --- | --- |
| Command | start-single-node |
| Environment | v24.3.3 |
| Go Version | go1.22.8 X:nocoverageredesign |
| Platform | linux amd64 |
| Distribution | CCL |
| Cockroach Release | v24.3.3 |
| Cockroach SHA | 343b4202e553d58a76a36c60018588615bd4c30a |
| # of CPUs | 24 |
| # of Goroutines | 1002 |

Jira issue: CRDB-60976

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.