Sentry: raft.go:2025: log.Fatal: 1 state.commit 6177 is out of range [6407, 6484] (1) attached stack trace -- stack trace: | github.com/cockroachdb/cockroach/pkg/raft.(*raft).loadState | github...

This issue was auto filed by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.

Sentry Link: [https://cockroach-labs.sentry.io/issues/7570448466/?referrer=webhooks_plugin](https://cockroach-labs.sentry.io/issues/7570448466/?referrer=webhooks_plugin)

Panic Message:

```
raft.go:2025: log.Fatal: 1 state.commit 6177 is out of range [6407, 6484]
(1) attached stack trace
-- stack trace:
| github.com/cockroachdb/cockroach/pkg/raft.(*raft).loadState
| github.com/cockroachdb/cockroach/pkg/raft/raft.go:2025
| github.com/cockroachdb/cockroach/pkg/raft.newRaft
| github.com/cockroachdb/cockroach/pkg/raft/raft.go:475
| github.com/cockroachdb/cockroach/pkg/raft.NewRawNode
| github.com/cockroachdb/cockroach/pkg/raft/rawnode.go:55
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).initRaftGroupRaftMuLockedReplicaMuLocked
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_init.go:294
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).initRaftMuLockedReplicaMuLocked
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_init.go:269
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.newInitializedReplica
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_init.go:80
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).Start
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/store.go:2181
| github.com/cockroachdb/cockroach/pkg/server.(*Node).start.func1
| github.com/cockroachdb/cockroach/pkg/server/node.go:681
| github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2
| github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:485
| runtime.goexit
| src/runtime/asm_amd64.s:1695
Wraps: (2) log.Fatal: 1 state.commit 6177 is out of range [6407, 6484]
Error types: (1) *withstack.withStack (2) *errutil.leafError
-- report composition:
*errutil.leafError: log.Fatal: 1 state.commit 6177 is out of range [6407, 6484]
raft.go:2025: *withstack.withStack (top exception)
```

Stacktrace (expand for inline code snippets):

[src/runtime/asm_amd64.s#L1694-L1696](src/runtime/asm_amd64.s#L1694-L1696)
[https://github.com/cockroachdb/cockroach/blob/484f8e2f4d3cb23582416944d79eab72ff42a6a1/pkg/util/stop/stopper.go#L484-L486](https://github.com/cockroachdb/cockroach/blob/484f8e2f4d3cb23582416944d79eab72ff42a6a1/pkg/util/stop/stopper.go#L484-L486)
[https://github.com/cockroachdb/cockroach/blob/484f8e2f4d3cb23582416944d79eab72ff42a6a1/pkg/server/node.go#L680-L682](https://github.com/cockroachdb/cockroach/blob/484f8e2f4d3cb23582416944d79eab72ff42a6a1/pkg/server/node.go#L680-L682)
[https://github.com/cockroachdb/cockroach/blob/484f8e2f4d3cb23582416944d79eab72ff42a6a1/pkg/kv/kvserver/pkg/kv/kvserver/store.go#L2180-L2182](https://github.com/cockroachdb/cockroach/blob/484f8e2f4d3cb23582416944d79eab72ff42a6a1/pkg/kv/kvserver/pkg/kv/kvserver/store.go#L2180-L2182)
[https://github.com/cockroachdb/cockroach/blob/484f8e2f4d3cb23582416944d79eab72ff42a6a1/pkg/kv/kvserver/pkg/kv/kvserver/replica_init.go#L79-L81](https://github.com/cockroachdb/cockroach/blob/484f8e2f4d3cb23582416944d79eab72ff42a6a1/pkg/kv/kvserver/pkg/kv/kvserver/replica_init.go#L79-L81)
[https://github.com/cockroachdb/cockroach/blob/484f8e2f4d3cb23582416944d79eab72ff42a6a1/pkg/kv/kvserver/pkg/kv/kvserver/replica_init.go#L268-L270](https://github.com/cockroachdb/cockroach/blob/484f8e2f4d3cb23582416944d79eab72ff42a6a1/pkg/kv/kvserver/pkg/kv/kvserver/replica_init.go#L268-L270)
[https://github.com/cockroachdb/cockroach/blob/484f8e2f4d3cb23582416944d79eab72ff42a6a1/pkg/kv/kvserver/pkg/kv/kvserver/replica_init.go#L293-L295](https://github.com/cockroachdb/cockroach/blob/484f8e2f4d3cb23582416944d79eab72ff42a6a1/pkg/kv/kvserver/pkg/kv/kvserver/replica_init.go#L293-L295)
[https://github.com/cockroachdb/cockroach/blob/484f8e2f4d3cb23582416944d79eab72ff42a6a1/pkg/raft/rawnode.go#L54-L56](https://github.com/cockroachdb/cockroach/blob/484f8e2f4d3cb23582416944d79eab72ff42a6a1/pkg/raft/rawnode.go#L54-L56)
[https://github.com/cockroachdb/cockroach/blob/484f8e2f4d3cb23582416944d79eab72ff42a6a1/pkg/raft/raft.go#L474-L476](https://github.com/cockroachdb/cockroach/blob/484f8e2f4d3cb23582416944d79eab72ff42a6a1/pkg/raft/raft.go#L474-L476)
[https://github.com/cockroachdb/cockroach/blob/484f8e2f4d3cb23582416944d79eab72ff42a6a1/pkg/raft/raft.go#L2024-L2026](https://github.com/cockroachdb/cockroach/blob/484f8e2f4d3cb23582416944d79eab72ff42a6a1/pkg/raft/raft.go#L2024-L2026)

```
src/runtime/asm_amd64.s in runtime.goexit at line 1695
pkg/util/stop/stopper.go in pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2 at line 485
pkg/server/node.go in pkg/server.(*Node).start.func1 at line 681
pkg/kv/kvserver/pkg/kv/kvserver/store.go in pkg/kv/kvserver.(*Store).Start at line 2181
pkg/kv/kvserver/pkg/kv/kvserver/replica_init.go in pkg/kv/kvserver.newInitializedReplica at line 80
pkg/kv/kvserver/pkg/kv/kvserver/replica_init.go in pkg/kv/kvserver.(*Replica).initRaftMuLockedReplicaMuLocked at line 269
pkg/kv/kvserver/pkg/kv/kvserver/replica_init.go in pkg/kv/kvserver.(*Replica).initRaftGroupRaftMuLockedReplicaMuLocked at line 294
pkg/raft/rawnode.go in pkg/raft.NewRawNode at line 55
pkg/raft/raft.go in pkg/raft.newRaft at line 475
pkg/raft/raft.go in pkg/raft.(*raft).loadState at line 2025
```

### Tags

| Tag | Value |
| --- | --- |
| Command | start-single-node |
| Environment | v24.1.1 |
| Go Version | go1.22.3 X:nocoverageredesign |
| Platform | linux amd64 |
| Distribution | CCL |
| Cockroach Release | v24.1.1 |
| Cockroach SHA | 484f8e2f4d3cb23582416944d79eab72ff42a6a1 |
| # of CPUs | 4 |
| # of Goroutines | 126 |

Jira issue: CRDB-65050

Start in pkg/raft/raft.go at loadState, using the reported commit and log range as the initial failure. Trace raft construction through pkg/raft/rawnode.go and pkg/kv/kvserver/replica_init.go to determine why startup reaches an out-of-range commit. Done means the live-cluster crash is prevented and the affected initialization path is covered by an appropriate regression test.

Written by the indexing model from the issue text.