Sentry: log.go:329: log.Fatal: tocommit(6859) is out of range [lastIndex(425)]. Was the raft log corrupted, truncated, or lost? (1) attached stack trace -- stack trace: | github.com/cockroachdb/co...

This issue was auto filed by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.

Sentry Link: [https://cockroach-labs.sentry.io/issues/6875205519/?referrer=webhooks_plugin](https://cockroach-labs.sentry.io/issues/6875205519/?referrer=webhooks_plugin)

Panic Message:

```
log.go:329: log.Fatal: tocommit(6859) is out of range [lastIndex(425)]. Was the raft log corrupted, truncated, or lost?
(1) attached stack trace
-- stack trace:
| github.com/cockroachdb/cockroach/pkg/raft.(*raftLog).commitTo
| github.com/cockroachdb/cockroach/pkg/raft/log.go:329
| github.com/cockroachdb/cockroach/pkg/raft.(*raft).handleHeartbeat
| github.com/cockroachdb/cockroach/pkg/raft/raft.go:1823
| github.com/cockroachdb/cockroach/pkg/raft.stepFollower
| github.com/cockroachdb/cockroach/pkg/raft/raft.go:1724
| github.com/cockroachdb/cockroach/pkg/raft.(*raft).Step
| github.com/cockroachdb/cockroach/pkg/raft/raft.go:1240
| github.com/cockroachdb/cockroach/pkg/raft.(*RawNode).Step
| github.com/cockroachdb/cockroach/pkg/raft/rawnode.go:129
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).processRaftRequestWithReplica.(*Replica).stepRaftGroup.func1
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go:633
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).withRaftGroupLocked
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go:2064
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).withRaftGroup
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go:2101
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).stepRaftGroup
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go:584
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).processRaftRequestWithReplica
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go:414
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).processRequestQueue.func1
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go:634
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).withReplicaForRequest
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go:369
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).processRequestQueue
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go:632
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftSchedulerShard).worker
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go:398
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go:320
| github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2
| github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:485
| runtime.goexit
| src/runtime/asm_amd64.s:1695
Wraps: (2) log.Fatal: tocommit(6859) is out of range [lastIndex(425)]. Was the raft log corrupted, truncated, or lost?
Error types: (1) *withstack.withStack (2) *errutil.leafError
-- report composition:
*errutil.leafError: log.Fatal: tocommit(6859) is out of range [lastIndex(425)]. Was the raft log corrupted, truncated, or lost?
log.go:329: *withstack.withStack (top exception)
```

Stacktrace (expand for inline code snippets):

[src/runtime/asm_amd64.s#L1694-L1696](src/runtime/asm_amd64.s#L1694-L1696)
[https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/util/stop/stopper.go#L484-L486](https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/util/stop/stopper.go#L484-L486)
[https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go#L319-L321](https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go#L319-L321)
[https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go#L397-L399](https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go#L397-L399)
[https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go#L631-L633](https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go#L631-L633)
[https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go#L368-L370](https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go#L368-L370)
[https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go#L633-L635](https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go#L633-L635)
[https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go#L413-L415](https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go#L413-L415)
[https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go#L583-L585](https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go#L583-L585)
[https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go#L2100-L2102](https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go#L2100-L2102)
[https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go#L2063-L2065](https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go#L2063-L2065)
[https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go#L632-L634](https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go#L632-L634)
[https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/raft/rawnode.go#L128-L130](https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/raft/rawnode.go#L128-L130)
[https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/raft/raft.go#L1239-L1241](https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/raft/raft.go#L1239-L1241)
[https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/raft/raft.go#L1723-L1725](https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/raft/raft.go#L1723-L1725)
[https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/raft/raft.go#L1822-L1824](https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/raft/raft.go#L1822-L1824)
[https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/raft/log.go#L328-L330](https://github.com/cockroachdb/cockroach/blob/f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2/pkg/raft/log.go#L328-L330)

```
src/runtime/asm_amd64.s in runtime.goexit at line 1695
pkg/util/stop/stopper.go in pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2 at line 485
pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go in pkg/kv/kvserver.(*raftScheduler).Start.func2 at line 320
pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go in pkg/kv/kvserver.(*raftSchedulerShard).worker at line 398
pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go in pkg/kv/kvserver.(*Store).processRequestQueue at line 632
pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go in pkg/kv/kvserver.(*Store).withReplicaForRequest at line 369
pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go in pkg/kv/kvserver.(*Store).processRequestQueue.func1 at line 634
pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go in pkg/kv/kvserver.(*Store).processRaftRequestWithReplica at line 414
pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go in pkg/kv/kvserver.(*Replica).stepRaftGroup at line 584
pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go in pkg/kv/kvserver.(*Replica).withRaftGroup at line 2101
pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go in pkg/kv/kvserver.(*Replica).withRaftGroupLocked at line 2064
pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go in pkg/kv/kvserver.(*Store).processRaftRequestWithReplica.(*Replica).stepRaftGroup.func1 at line 633
pkg/raft/rawnode.go in pkg/raft.(*RawNode).Step at line 129
pkg/raft/raft.go in pkg/raft.(*raft).Step at line 1240
pkg/raft/raft.go in pkg/raft.stepFollower at line 1724
pkg/raft/raft.go in pkg/raft.(*raft).handleHeartbeat at line 1823
pkg/raft/log.go in pkg/raft.(*raftLog).commitTo at line 329
```

### Tags

| Tag | Value |
| --- | --- |
| Command | server |
| Environment | v24.1.5 |
| Go Version | go1.22.5 X:nocoverageredesign |
| Platform | linux amd64 |
| Distribution | CCL |
| Cockroach Release | v24.1.5 |
| Cockroach SHA | f3ff8fb7b0e314dbf1b2765da155df91fa5b44b2 |
| # of CPUs | 4 |
| # of Goroutines | 289 |

Jira issue: CRDB-54441