cockroachdb / cockroachdb/cockroach

Sentry: log.go:382: log.Fatal: applied(4134634) is out of range [prevApplied(4134584), committed(4134632)] (1) attached stack trace -- stack trace: | github.com/cockroachdb/cockroach/pkg/raft.(*ra...

Open
#148,199 2 comments 0 reactions 0 assignees View on GitHub
branch-release-24.3 C-bug O-sentry T-kv X-blathers-triaged
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

This issue was auto filed by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.

Sentry Link: [https://cockroach-labs.sentry.io/issues/6674824593/?referrer=webhooks_plugin](https://cockroach-labs.sentry.io/issues/6674824593/?referrer=webhooks_plugin)

Panic Message:

```
log.go:382: log.Fatal: applied(4134634) is out of range [prevApplied(4134584), committed(4134632)]
(1) attached stack trace
-- stack trace:
| github.com/cockroachdb/cockroach/pkg/raft.(*raftLog).appliedTo
| pkg/raft/log.go:382
| github.com/cockroachdb/cockroach/pkg/raft.newRaft
| pkg/raft/raft.go:486
| github.com/cockroachdb/cockroach/pkg/raft.NewRawNode
| pkg/raft/rawnode.go:54
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).initRaftGroupRaftMuLockedReplicaMuLocked
| pkg/kv/kvserver/replica_init.go:321
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).initRaftMuLockedReplicaMuLocked
| pkg/kv/kvserver/replica_init.go:296
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.newInitializedReplica
| pkg/kv/kvserver/replica_init.go:81
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Start
| pkg/kv/kvserver/store.go:2288
| github.com/cockroachdb/cockroach/pkg/server.(*Node).start.func1
| pkg/server/node.go:699
| github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2
| pkg/util/stop/stopper.go:498
| runtime.goexit
| src/runtime/asm_amd64.s:1695
Wraps: (2) log.Fatal: applied(4134634) is out of range [prevApplied(4134584), committed(4134632)]
Error types: (1) *withstack.withStack (2) *errutil.leafError
-- report composition:
*errutil.leafError: log.Fatal: applied(4134634) is out of range [prevApplied(4134584), committed(4134632)]
log.go:382: *withstack.withStack (top exception)
```

Stacktrace (expand for inline code snippets):

[src/runtime/asm_amd64.s#L1694-L1696](src/runtime/asm_amd64.s#L1694-L1696)
[pkg/util/stop/stopper.go#L497-L499](pkg/util/stop/stopper.go#L497-L499)
[pkg/server/node.go#L698-L700](pkg/server/node.go#L698-L700)
[pkg/kv/kvserver/store.go#L2287-L2289](pkg/kv/kvserver/store.go#L2287-L2289)
[pkg/kv/kvserver/replica_init.go#L80-L82](pkg/kv/kvserver/replica_init.go#L80-L82)
[pkg/kv/kvserver/replica_init.go#L295-L297](pkg/kv/kvserver/replica_init.go#L295-L297)
[pkg/kv/kvserver/replica_init.go#L320-L322](pkg/kv/kvserver/replica_init.go#L320-L322)
[pkg/raft/rawnode.go#L53-L55](pkg/raft/rawnode.go#L53-L55)
[pkg/raft/raft.go#L485-L487](pkg/raft/raft.go#L485-L487)
[pkg/raft/log.go#L381-L383](pkg/raft/log.go#L381-L383)

```
src/runtime/asm_amd64.s in runtime.goexit at line 1695
pkg/util/stop/stopper.go in pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2 at line 498
pkg/server/node.go in pkg/server.(*Node).start.func1 at line 699
pkg/kv/kvserver/store.go in pkg/kv/kvserver.(*Store).Start at line 2288
pkg/kv/kvserver/replica_init.go in pkg/kv/kvserver.newInitializedReplica at line 81
pkg/kv/kvserver/replica_init.go in pkg/kv/kvserver.(*Replica).initRaftMuLockedReplicaMuLocked at line 296
pkg/kv/kvserver/replica_init.go in pkg/kv/kvserver.(*Replica).initRaftGroupRaftMuLockedReplicaMuLocked at line 321
pkg/raft/rawnode.go in pkg/raft.NewRawNode at line 54
pkg/raft/raft.go in pkg/raft.newRaft at line 486
pkg/raft/log.go in pkg/raft.(*raftLog).appliedTo at line 382
```

### Tags

| Tag | Value |
| --- | --- |
| Command | server |
| Environment | v24.3.6 |
| Go Version | go1.22.8 X:nocoverageredesign |
| Platform | linux amd64 |
| Distribution | CCL |
| Cockroach Release | v24.3.6 |
| Cockroach SHA | 5df37049d6ba68a9eb08b1643a8755f5c4d89d21 |
| # of CPUs | 16 |
| # of Goroutines | 924 |

Jira issue: CRDB-51470

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.