cockroachdb / cockroachdb/cockroach

Sentry: panic.go:770: runtime error: invalid memory address or nil pointer dereference (1) attached stack trace -- stack trace: | runtime.gopanic | GOROOT/src/runtime/panic.go:770 | github.co...

Open
#164,714 1 comment 0 reactions 0 assignees View on GitHub
branch-release-24.3 C-bug O-sentry T-kv X-blathers-triaged
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

This issue was auto filed by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.

Sentry Link: [https://cockroach-labs.sentry.io/issues/7305069358/?referrer=webhooks_plugin](https://cockroach-labs.sentry.io/issues/7305069358/?referrer=webhooks_plugin)

Panic Message:

```
panic.go:770: runtime error: invalid memory address or nil pointer dereference
(1) attached stack trace
-- stack trace:
| runtime.gopanic
| GOROOT/src/runtime/panic.go:770
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).SendWithWriteBytes.func1
| pkg/kv/kvserver/store_send.go:104
| runtime.gopanic
| GOROOT/src/runtime/panic.go:770
| runtime.panicmem
| GOROOT/src/runtime/panic.go:261
| runtime.sigpanic
| GOROOT/src/runtime/signal_unix.go:881
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/spanlatch.(*latchList).remove
| pkg/kv/kvserver/spanlatch/list.go:40
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/spanlatch.(*scopedManager).flushReadSetLocked
| pkg/kv/kvserver/spanlatch/manager.go:428
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/spanlatch.(*Manager).snapshotLocked
| pkg/kv/kvserver/spanlatch/manager.go:414
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/spanlatch.(*Manager).sequence
| pkg/kv/kvserver/spanlatch/manager.go:384
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/spanlatch.(*Manager).Acquire
| pkg/kv/kvserver/spanlatch/manager.go:243
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency.(*latchManagerImpl).Acquire
| pkg/kv/kvserver/concurrency/latch_manager.go:24
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency.(*managerImpl).sequenceReqWithGuard
| pkg/kv/kvserver/concurrency/concurrency_manager.go:291
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/concurrency.(*managerImpl).SequenceReq
| pkg/kv/kvserver/concurrency/concurrency_manager.go:239
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries
| pkg/kv/kvserver/replica_send.go:453
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).SendWithWriteBytes
| pkg/kv/kvserver/replica_send.go:177
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).SendWithWriteBytes
| pkg/kv/kvserver/store_send.go:188
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Stores).SendWithWriteBytes
| pkg/kv/kvserver/stores.go:197
| github.com/cockroachdb/cockroach/pkg/server.(*Node).batchInternal
| pkg/server/node.go:1636
| github.com/cockroachdb/cockroach/pkg/server.(*Node).Batch
| pkg/server/node.go:1837
| github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.func1
| pkg/rpc/context.go:713
| github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.ServerInterceptor.func12
| pkg/util/tracing/grpcinterceptor/grpc_interceptor.go:92
| github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4
| pkg/rpc/context.go:824
| github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.func3
| pkg/rpc/context.go:165
| github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4
| pkg/rpc/context.go:824
| github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.func1.1
| pkg/rpc/context.go:132
| github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunTaskWithErr
| pkg/util/stop/stopper.go:349
| github.com/cockroachdb/cockroach/pkg/rpc.NewServerEx.func1
| pkg/rpc/context.go:130
| github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4
| pkg/rpc/context.go:824
| github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.func2
| pkg/rpc/context.go:723
| github.com/cockroachdb/cockroach/pkg/rpc.NewContext.ClientInterceptor.func8
| pkg/util/tracing/grpcinterceptor/grpc_interceptor.go:223
| github.com/cockroachdb/cockroach/pkg/rpc.getChainUnaryInvoker.func1
| pkg/rpc/context.go:908
| github.com/cockroachdb/cockroach/pkg/rpc.makeInternalClientAdapter.func3
| pkg/rpc/context.go:793
Wraps: (2) runtime error: invalid memory address or nil pointer dereference
Error types: (1) *withstack.withStack (2) runtime.errorString
-- report composition:
runtime.errorString
panic.go:770: *withstack.withStack (top exception)
```

Stacktrace (expand for inline code snippets):

[pkg/rpc/context.go#L792-L794](pkg/rpc/context.go#L792-L794)
[pkg/rpc/context.go#L907-L909](pkg/rpc/context.go#L907-L909)
[pkg/util/tracing/grpcinterceptor/grpc_interceptor.go#L222-L224](pkg/util/tracing/grpcinterceptor/grpc_interceptor.go#L222-L224)
[pkg/rpc/context.go#L722-L724](pkg/rpc/context.go#L722-L724)
[pkg/rpc/context.go#L823-L825](pkg/rpc/context.go#L823-L825)
[pkg/rpc/context.go#L129-L131](pkg/rpc/context.go#L129-L131)
[pkg/util/stop/stopper.go#L348-L350](pkg/util/stop/stopper.go#L348-L350)
[pkg/rpc/context.go#L131-L133](pkg/rpc/context.go#L131-L133)
[pkg/rpc/context.go#L823-L825](pkg/rpc/context.go#L823-L825)
[pkg/rpc/context.go#L164-L166](pkg/rpc/context.go#L164-L166)
[pkg/rpc/context.go#L823-L825](pkg/rpc/context.go#L823-L825)
[pkg/util/tracing/grpcinterceptor/grpc_interceptor.go#L91-L93](pkg/util/tracing/grpcinterceptor/grpc_interceptor.go#L91-L93)
[pkg/rpc/context.go#L712-L714](pkg/rpc/context.go#L712-L714)
[pkg/server/node.go#L1836-L1838](pkg/server/node.go#L1836-L1838)
[pkg/server/node.go#L1635-L1637](pkg/server/node.go#L1635-L1637)
[pkg/kv/kvserver/stores.go#L196-L198](pkg/kv/kvserver/stores.go#L196-L198)
[pkg/kv/kvserver/store_send.go#L187-L189](pkg/kv/kvserver/store_send.go#L187-L189)
[pkg/kv/kvserver/replica_send.go#L176-L178](pkg/kv/kvserver/replica_send.go#L176-L178)
[pkg/kv/kvserver/replica_send.go#L452-L454](pkg/kv/kvserver/replica_send.go#L452-L454)
[pkg/kv/kvserver/concurrency/concurrency_manager.go#L238-L240](pkg/kv/kvserver/concurrency/concurrency_manager.go#L238-L240)
[pkg/kv/kvserver/concurrency/concurrency_manager.go#L290-L292](pkg/kv/kvserver/concurrency/concurrency_manager.go#L290-L292)
[pkg/kv/kvserver/concurrency/latch_manager.go#L23-L25](pkg/kv/kvserver/concurrency/latch_manager.go#L23-L25)
[pkg/kv/kvserver/spanlatch/manager.go#L242-L244](pkg/kv/kvserver/spanlatch/manager.go#L242-L244)
[pkg/kv/kvserver/spanlatch/manager.go#L383-L385](pkg/kv/kvserver/spanlatch/manager.go#L383-L385)
[pkg/kv/kvserver/spanlatch/manager.go#L413-L415](pkg/kv/kvserver/spanlatch/manager.go#L413-L415)
[pkg/kv/kvserver/spanlatch/manager.go#L427-L429](pkg/kv/kvserver/spanlatch/manager.go#L427-L429)
[pkg/kv/kvserver/spanlatch/list.go#L39-L41](pkg/kv/kvserver/spanlatch/list.go#L39-L41)
[GOROOT/src/runtime/signal_unix.go#L880-L882](GOROOT/src/runtime/signal_unix.go#L880-L882)
[GOROOT/src/runtime/panic.go#L260-L262](GOROOT/src/runtime/panic.go#L260-L262)
[GOROOT/src/runtime/panic.go#L769-L771](GOROOT/src/runtime/panic.go#L769-L771)
[pkg/kv/kvserver/store_send.go#L103-L105](pkg/kv/kvserver/store_send.go#L103-L105)
[GOROOT/src/runtime/panic.go#L769-L771](GOROOT/src/runtime/panic.go#L769-L771)

```
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.func3 at line 793
pkg/rpc/context.go in pkg/rpc.getChainUnaryInvoker.func1 at line 908
pkg/util/tracing/grpcinterceptor/grpc_interceptor.go in pkg/rpc.NewContext.ClientInterceptor.func8 at line 223
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.func2 at line 723
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4 at line 824
pkg/rpc/context.go in pkg/rpc.NewServerEx.func1 at line 130
pkg/util/stop/stopper.go in pkg/util/stop.(*Stopper).RunTaskWithErr at line 349
pkg/rpc/context.go in pkg/rpc.NewServerEx.func1.1 at line 132
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4 at line 824
pkg/rpc/context.go in pkg/rpc.NewServerEx.func3 at line 165
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.chainUnaryServerInterceptors.bindUnaryServerInterceptorToHandler.func4 at line 824
pkg/util/tracing/grpcinterceptor/grpc_interceptor.go in pkg/rpc.NewServerEx.ServerInterceptor.func12 at line 92
pkg/rpc/context.go in pkg/rpc.makeInternalClientAdapter.func1 at line 713
pkg/server/node.go in pkg/server.(*Node).Batch at line 1837
pkg/server/node.go in pkg/server.(*Node).batchInternal at line 1636
pkg/kv/kvserver/stores.go in pkg/kv/kvserver.(*Stores).SendWithWriteBytes at line 197
pkg/kv/kvserver/store_send.go in pkg/kv/kvserver.(*Store).SendWithWriteBytes at line 188
pkg/kv/kvserver/replica_send.go in pkg/kv/kvserver.(*Replica).SendWithWriteBytes at line 177
pkg/kv/kvserver/replica_send.go in pkg/kv/kvserver.(*Replica).executeBatchWithConcurrencyRetries at line 453
pkg/kv/kvserver/concurrency/concurrency_manager.go in pkg/kv/kvserver/concurrency.(*managerImpl).SequenceReq at line 239
pkg/kv/kvserver/concurrency/concurrency_manager.go in pkg/kv/kvserver/concurrency.(*managerImpl).sequenceReqWithGuard at line 291
pkg/kv/kvserver/concurrency/latch_manager.go in pkg/kv/kvserver/concurrency.(*latchManagerImpl).Acquire at line 24
pkg/kv/kvserver/spanlatch/manager.go in pkg/kv/kvserver/spanlatch.(*Manager).Acquire at line 243
pkg/kv/kvserver/spanlatch/manager.go in pkg/kv/kvserver/spanlatch.(*Manager).sequence at line 384
pkg/kv/kvserver/spanlatch/manager.go in pkg/kv/kvserver/spanlatch.(*Manager).snapshotLocked at line 414
pkg/kv/kvserver/spanlatch/manager.go in pkg/kv/kvserver/spanlatch.(*scopedManager).flushReadSetLocked at line 428
pkg/kv/kvserver/spanlatch/list.go in pkg/kv/kvserver/spanlatch.(*latchList).remove at line 40
GOROOT/src/runtime/signal_unix.go in runtime.sigpanic at line 881
GOROOT/src/runtime/panic.go in runtime.panicmem at line 261
GOROOT/src/runtime/panic.go in runtime.gopanic at line 770
pkg/kv/kvserver/store_send.go in pkg/kv/kvserver.(*Store).SendWithWriteBytes.func1 at line 104
GOROOT/src/runtime/panic.go in runtime.gopanic at line 770
```

### Tags

| Tag | Value |
| --- | --- |
| Command | start-single-node |
| Environment | v24.3.3 |
| Go Version | go1.22.8 X:nocoverageredesign |
| Platform | linux amd64 |
| Distribution | CCL |
| Cockroach Release | v24.3.3 |
| Cockroach SHA | 343b4202e553d58a76a36c60018588615bd4c30a |
| # of CPUs | 24 |
| # of Goroutines | 998 |

Jira issue: CRDB-60977

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.