cockroachdb / cockroachdb/cockroach

Sentry: replica_proposal.go:701: log.Fatal: checksum for AddSSTable at index term 7, index 29 does not match; at proposal time f893bab1 (4170431153), now 792089f6 (2032175606) (1) attached stack trace...

Open
#148,793 1 comment 0 reactions 0 assignees View on GitHub
branch-release-25.2 C-bug O-sentry T-kv X-blathers-triaged
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

This issue was auto filed by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.

Sentry Link: [https://cockroach-labs.sentry.io/issues/6707695813/?referrer=webhooks_plugin](https://cockroach-labs.sentry.io/issues/6707695813/?referrer=webhooks_plugin)

Panic Message:

```
replica_proposal.go:701: log.Fatal: checksum for AddSSTable at index term 7, index 29 does not match; at proposal time f893bab1 (4170431153), now 792089f6 (2032175606)
(1) attached stack trace
-- stack trace:
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.addSSTablePreApply
| pkg/kv/kvserver/replica_proposal.go:701
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*appBatch).runPostAddTriggers
| pkg/kv/kvserver/app_batch.go:173
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*replicaAppBatch).Stage
| pkg/kv/kvserver/replica_app_batch.go:148
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/apply.mapCmdIter
| pkg/kv/kvserver/apply/cmd.go:187
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/apply.(*Task).applyOneBatch
| pkg/kv/kvserver/apply/task.go:279
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/apply.(*Task).ApplyCommittedEntries
| pkg/kv/kvserver/apply/task.go:246
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).handleRaftReadyRaftMuLocked
| pkg/kv/kvserver/replica_raft.go:1281
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).handleRaftReady
| pkg/kv/kvserver/replica_raft.go:875
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Store).processReady
| pkg/kv/kvserver/store_raft.go:755
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftSchedulerShard).worker
| pkg/kv/kvserver/scheduler.go:419
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*raftScheduler).Start.func2
| pkg/kv/kvserver/scheduler.go:319
| github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2
| pkg/util/stop/stopper.go:500
| runtime.goexit
| src/runtime/asm_amd64.s:1700
Wraps: (2) log.Fatal: checksum for AddSSTable at index term 7, index 29 does not match; at proposal time f893bab1 (4170431153), now 792089f6 (2032175606)
Error types: (1) *withstack.withStack (2) *errutil.leafError
-- report composition:
*errutil.leafError: log.Fatal: checksum for AddSSTable at index term 7, index 29 does not match; at proposal time f893bab1 (4170431153), now 792089f6 (2032175606)
replica_proposal.go:701: *withstack.withStack (top exception)
```

Stacktrace (expand for inline code snippets):

[src/runtime/asm_amd64.s#L1699-L1701](src/runtime/asm_amd64.s#L1699-L1701)
[pkg/util/stop/stopper.go#L499-L501](pkg/util/stop/stopper.go#L499-L501)
[pkg/kv/kvserver/scheduler.go#L318-L320](pkg/kv/kvserver/scheduler.go#L318-L320)
[pkg/kv/kvserver/scheduler.go#L418-L420](pkg/kv/kvserver/scheduler.go#L418-L420)
[pkg/kv/kvserver/store_raft.go#L754-L756](pkg/kv/kvserver/store_raft.go#L754-L756)
[pkg/kv/kvserver/replica_raft.go#L874-L876](pkg/kv/kvserver/replica_raft.go#L874-L876)
[pkg/kv/kvserver/replica_raft.go#L1280-L1282](pkg/kv/kvserver/replica_raft.go#L1280-L1282)
[pkg/kv/kvserver/apply/task.go#L245-L247](pkg/kv/kvserver/apply/task.go#L245-L247)
[pkg/kv/kvserver/apply/task.go#L278-L280](pkg/kv/kvserver/apply/task.go#L278-L280)
[pkg/kv/kvserver/apply/cmd.go#L186-L188](pkg/kv/kvserver/apply/cmd.go#L186-L188)
[pkg/kv/kvserver/replica_app_batch.go#L147-L149](pkg/kv/kvserver/replica_app_batch.go#L147-L149)
[pkg/kv/kvserver/app_batch.go#L172-L174](pkg/kv/kvserver/app_batch.go#L172-L174)
[pkg/kv/kvserver/replica_proposal.go#L700-L702](pkg/kv/kvserver/replica_proposal.go#L700-L702)

```
src/runtime/asm_amd64.s in runtime.goexit at line 1700
pkg/util/stop/stopper.go in pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2 at line 500
pkg/kv/kvserver/scheduler.go in pkg/kv/kvserver.(*raftScheduler).Start.func2 at line 319
pkg/kv/kvserver/scheduler.go in pkg/kv/kvserver.(*raftSchedulerShard).worker at line 419
pkg/kv/kvserver/store_raft.go in pkg/kv/kvserver.(*Store).processReady at line 755
pkg/kv/kvserver/replica_raft.go in pkg/kv/kvserver.(*Replica).handleRaftReady at line 875
pkg/kv/kvserver/replica_raft.go in pkg/kv/kvserver.(*Replica).handleRaftReadyRaftMuLocked at line 1281
pkg/kv/kvserver/apply/task.go in pkg/kv/kvserver/apply.(*Task).ApplyCommittedEntries at line 246
pkg/kv/kvserver/apply/task.go in pkg/kv/kvserver/apply.(*Task).applyOneBatch at line 279
pkg/kv/kvserver/apply/cmd.go in pkg/kv/kvserver/apply.mapCmdIter at line 187
pkg/kv/kvserver/replica_app_batch.go in pkg/kv/kvserver.(*replicaAppBatch).Stage at line 148
pkg/kv/kvserver/app_batch.go in pkg/kv/kvserver.(*appBatch).runPostAddTriggers at line 173
pkg/kv/kvserver/replica_proposal.go in pkg/kv/kvserver.addSSTablePreApply at line 701
```

### Tags

| Tag | Value |
| --- | --- |
| Command | server |
| Environment | v25.2.1 |
| Go Version | go1.23.7 X:nocoverageredesign |
| Platform | linux amd64 |
| Distribution | CCL |
| Cockroach Release | v25.2.1 |
| Cockroach SHA | f9f183de9d58b822d6cf4c12c560e1fbbc70707f |
| # of CPUs | 8 |
| # of Goroutines | 584 |

Jira issue: CRDB-51807

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.