Sentry: log.go:329: log.Fatal: tocommit(192650730) is out of range [lastIndex(192643137)]. Was the raft log corrupted, truncated, or lost? (1) attached stack trace -- stack trace: | github.com/coc...

This issue was auto filed by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.

Sentry Link: [https://cockroach-labs.sentry.io/issues/7534422794/?referrer=webhooks_plugin](https://cockroach-labs.sentry.io/issues/7534422794/?referrer=webhooks_plugin)

Panic Message:

```
log.go:329: log.Fatal: tocommit(192650730) is out of range [lastIndex(192643137)]. Was the raft log corrupted, truncated, or lost?
(1) attached stack trace
-- stack trace:
| github.com/cockroachdb/cockroach/pkg/raft.(*raftLog).commitTo
| github.com/cockroachdb/cockroach/pkg/raft/log.go:329
| github.com/cockroachdb/cockroach/pkg/raft.(*raft).handleHeartbeat
| github.com/cockroachdb/cockroach/pkg/raft/raft.go:1823
| github.com/cockroachdb/cockroach/pkg/raft.stepFollower
| github.com/cockroachdb/cockroach/pkg/raft/raft.go:1724
| github.com/cockroachdb/cockroach/pkg/raft.(*raft).Step
| github.com/cockroachdb/cockroach/pkg/raft/raft.go:1240
| github.com/cockroachdb/cockroach/pkg/raft.(*RawNode).Step
| github.com/cockroachdb/cockroach/pkg/raft/rawnode.go:128
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).processRaftRequestWithReplica.(*Replica).stepRaftGroup.func1
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go:628
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).withRaftGroupLocked
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go:2059
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).withRaftGroup
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go:2096
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).stepRaftGroup
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go:579
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).processRaftRequestWithReplica
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go:409
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).processRequestQueue.func1
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go:629
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).withReplicaForRequest
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go:364
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).processRequestQueue
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go:627
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftSchedulerShard).worker
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go:393
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go:315
| github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2
| github.com/cockroachdb/cockroach/pkg/util/stop/stopper.go:480
| runtime.goexit
| src/runtime/asm_amd64.s:1695
Wraps: (2) log.Fatal: tocommit(192650730) is out of range [lastIndex(192643137)]. Was the raft log corrupted, truncated, or lost?
Error types: (1) *withstack.withStack (2) *errutil.leafError
-- report composition:
*errutil.leafError: log.Fatal: tocommit(192650730) is out of range [lastIndex(192643137)]. Was the raft log corrupted, truncated, or lost?
log.go:329: *withstack.withStack (top exception)
```

Stacktrace (expand for inline code snippets):

[src/runtime/asm_amd64.s#L1694-L1696](src/runtime/asm_amd64.s#L1694-L1696)
[https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/util/stop/stopper.go#L479-L481](https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/util/stop/stopper.go#L479-L481)
[https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go#L314-L316](https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go#L314-L316)
[https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go#L392-L394](https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go#L392-L394)
[https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go#L626-L628](https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go#L626-L628)
[https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go#L363-L365](https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go#L363-L365)
[https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go#L628-L630](https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go#L628-L630)
[https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go#L408-L410](https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go#L408-L410)
[https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go#L578-L580](https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go#L578-L580)
[https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go#L2095-L2097](https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go#L2095-L2097)
[https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go#L2058-L2060](https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go#L2058-L2060)
[https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go#L627-L629](https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go#L627-L629)
[https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/raft/rawnode.go#L127-L129](https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/raft/rawnode.go#L127-L129)
[https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/raft/raft.go#L1239-L1241](https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/raft/raft.go#L1239-L1241)
[https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/raft/raft.go#L1723-L1725](https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/raft/raft.go#L1723-L1725)
[https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/raft/raft.go#L1822-L1824](https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/raft/raft.go#L1822-L1824)
[https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/raft/log.go#L328-L330](https://github.com/cockroachdb/cockroach/blob/b2d9e467bbe18f26450bf5600c249d2b59765b9a/pkg/raft/log.go#L328-L330)

```
src/runtime/asm_amd64.s in runtime.goexit at line 1695
pkg/util/stop/stopper.go in pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2 at line 480
pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go in pkg/kv/kvserver.(*raftScheduler).Start.func2 at line 315
pkg/kv/kvserver/pkg/kv/kvserver/scheduler.go in pkg/kv/kvserver.(*raftSchedulerShard).worker at line 393
pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go in pkg/kv/kvserver.(*Store).processRequestQueue at line 627
pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go in pkg/kv/kvserver.(*Store).withReplicaForRequest at line 364
pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go in pkg/kv/kvserver.(*Store).processRequestQueue.func1 at line 629
pkg/kv/kvserver/pkg/kv/kvserver/store_raft.go in pkg/kv/kvserver.(*Store).processRaftRequestWithReplica at line 409
pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go in pkg/kv/kvserver.(*Replica).stepRaftGroup at line 579
pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go in pkg/kv/kvserver.(*Replica).withRaftGroup at line 2096
pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go in pkg/kv/kvserver.(*Replica).withRaftGroupLocked at line 2059
pkg/kv/kvserver/pkg/kv/kvserver/replica_raft.go in pkg/kv/kvserver.(*Store).processRaftRequestWithReplica.(*Replica).stepRaftGroup.func1 at line 628
pkg/raft/rawnode.go in pkg/raft.(*RawNode).Step at line 128
pkg/raft/raft.go in pkg/raft.(*raft).Step at line 1240
pkg/raft/raft.go in pkg/raft.stepFollower at line 1724
pkg/raft/raft.go in pkg/raft.(*raft).handleHeartbeat at line 1823
pkg/raft/log.go in pkg/raft.(*raftLog).commitTo at line 329
```

### Tags

| Tag | Value |
| --- | --- |
| Command | server |
| Environment | v24.1.23 |
| Go Version | go1.22.12 X:nocoverageredesign |
| Platform | linux amd64 |
| Distribution | CCL |
| Cockroach Release | v24.1.23 |
| Cockroach SHA | b2d9e467bbe18f26450bf5600c249d2b59765b9a |
| # of CPUs | 8 |
| # of Goroutines | 337 |

Jira issue: CRDB-64603