basalt-26.3: roachtest: tpccbench/nodes=3/cpu=16/enc=true/binary=basalt/storage=basalt/basalt_nodes=3/rsengine=disabled failed

roachtest.tpccbench/nodes=3/cpu=16/enc=true/binary=basalt/storage=basalt/basalt_nodes=3/rsengine=disabled [failed](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_Roachtests_RoachtestNightlyBenchmarksGcePrivateBasaltBazel/21514659?buildTab=log) with [artifacts](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_Roachtests_RoachtestNightlyBenchmarksGcePrivateBasaltBazel/21514659?buildTab=artifacts#/tpccbench/nodes=3/cpu=16/enc=true/binary=basalt/storage=basalt/basalt_nodes=3/rsengine=disabled) on basalt-26.3 @ [4fda4910b2015319b2f775e42d2f2fb15130d19a](https://github.com/cockroachdb/cockroach/commits/4fda4910b2015319b2f775e42d2f2fb15130d19a):

Failed with:

```
(monitor.go:267).Wait: monitor failure: full command output in run_132019.359793709_n1_cockroach-workload-f.log: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/tpccbench/nodes=3/cpu=16/enc=true/binary=basalt/storage=basalt/basalt_nodes=3/rsengine=disabled/run_1
```
Fatal entries found in Cockroach logs:

```
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 249 while storing log entries: during sideloading: ‹replica writer: quorum impossible for batch (0 success + 1 remaining < 2 quorum)›
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 249 +(1) attached stack trace
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 249 + -- stack trace:
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 249 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).handleRaftReadyRaftMuLocked
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 249 + | pkg/kv/kvserver/replica_raft.go:1217
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 249 + | [...repeated from below...]
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 249 +Wraps: (2) while storing log entries
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 249 +Wraps: (3) attached stack trace
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 249 + -- stack trace:
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 249 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/logstore.(*LogStore).storeEntriesAndCommitBatch
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 249 while storing log entries: during sideloading: ‹replica writer: quorum impossible for batch (0 success + 1 remaining < 2 quorum)›
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 249 +(1) attached stack trace
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 249 + -- stack trace:
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 249 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).handleRaftReadyRaftMuLocked
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 249 + | pkg/kv/kvserver/replica_raft.go:1217
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 249 + | [...repeated from below...]
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 249 +Wraps: (2) while storing log entries
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 249 +Wraps: (3) attached stack trace
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 249 + -- stack trace:
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 249 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/logstore.(*LogStore).storeEntriesAndCommitBatch
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1790 while storing log entries: during sideloading: ‹replica writer: quorum impossible for batch (0 success + 1 remaining < 2 quorum)›
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1790 +(1) attached stack trace
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1790 + -- stack trace:
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1790 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).handleRaftReadyRaftMuLocked
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1790 + | pkg/kv/kvserver/replica_raft.go:1217
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1790 + | [...repeated from below...]
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1790 +Wraps: (2) while storing log entries
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1790 +Wraps: (3) attached stack trace
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1790 + -- stack trace:
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1790 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/logstore.(*LogStore).storeEntriesAndCommitBatch
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/2{493/6…-933/3…},raft] 87400 while storing log entries: during sideloading: replica writer: quorum impossible for batch (0 success + 1 remaining < 2 quorum)
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/2{493/6…-933/3…},raft] 87400 +(1) attached stack trace
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/2{493/6…-933/3…},raft] 87400 + -- stack trace:
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/2{493/6…-933/3…},raft] 87400 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).handleRaftReadyRaftMuLocked
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/2{493/6…-933/3…},raft] 87400 + | pkg/kv/kvserver/replica_raft.go:1217
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/2{493/6…-933/3…},raft] 87400 + | [...repeated from below...]
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/2{493/6…-933/3…},raft] 87400 +Wraps: (2) while storing log entries
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/2{493/6…-933/3…},raft] 87400 +Wraps: (3) attached stack trace
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/2{493/6…-933/3…},raft] 87400 + -- stack trace:
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/2{493/6…-933/3…},raft] 87400 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/logstore.(*LogStore).storeEntriesAndCommitBatch
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1790 while storing log entries: during sideloading: ‹replica writer: quorum impossible for batch (0 success + 1 remaining < 2 quorum)›
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1790 +(1) attached stack trace
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1790 + -- stack trace:
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1790 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).handleRaftReadyRaftMuLocked
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1790 + | pkg/kv/kvserver/replica_raft.go:1217
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1790 + | [...repeated from below...]
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1790 +Wraps: (2) while storing log entries
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1790 +Wraps: (3) attached stack trace
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1790 + -- stack trace:
F260913 14:31:15.005234 948 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n1,s1,r1701/1:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1790 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/logstore.(*LogStore).storeEntriesAndCommitBatch
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 297 while storing log entries: during sideloading: ‹replica writer: quorum impossible for batch (0 success + 1 remaining < 2 quorum)›
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 297 +(1) attached stack trace
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 297 + -- stack trace:
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 297 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).handleRaftReadyRaftMuLocked
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 297 + | pkg/kv/kvserver/replica_raft.go:1217
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 297 + | [...repeated from below...]
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 297 +Wraps: (2) while storing log entries
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 297 +Wraps: (3) attached stack trace
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 297 + -- stack trace:
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 297 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/logstore.(*LogStore).storeEntriesAndCommitBatch
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 297 while storing log entries: during sideloading: ‹replica writer: quorum impossible for batch (0 success + 1 remaining < 2 quorum)›
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 297 +(1) attached stack trace
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 297 + -- stack trace:
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 297 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).handleRaftReadyRaftMuLocked
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 297 + | pkg/kv/kvserver/replica_raft.go:1217
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 297 + | [...repeated from below...]
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 297 +Wraps: (2) while storing log entries
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 297 +Wraps: (3) attached stack trace
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 297 + -- stack trace:
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 297 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/logstore.(*LogStore).storeEntriesAndCommitBatch
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1197 while storing log entries: during sideloading: ‹replica writer: quorum impossible for batch (0 success + 1 remaining < 2 quorum)›
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1197 +(1) attached stack trace
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1197 + -- stack trace:
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1197 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).handleRaftReadyRaftMuLocked
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1197 + | pkg/kv/kvserver/replica_raft.go:1217
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1197 + | [...repeated from below...]
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1197 +Wraps: (2) while storing log entries
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1197 +Wraps: (3) attached stack trace
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1197 + -- stack trace:
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1197 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/logstore.(*LogStore).storeEntriesAndCommitBatch
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/2{493/6…-933/3…},raft] 144342 while storing log entries: during sideloading: replica writer: quorum impossible for batch (0 success + 1 remaining < 2 quorum)
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/2{493/6…-933/3…},raft] 144342 +(1) attached stack trace
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/2{493/6…-933/3…},raft] 144342 + -- stack trace:
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/2{493/6…-933/3…},raft] 144342 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).handleRaftReadyRaftMuLocked
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/2{493/6…-933/3…},raft] 144342 + | pkg/kv/kvserver/replica_raft.go:1217
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/2{493/6…-933/3…},raft] 144342 + | [...repeated from below...]
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/2{493/6…-933/3…},raft] 144342 +Wraps: (2) while storing log entries
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/2{493/6…-933/3…},raft] 144342 +Wraps: (3) attached stack trace
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/2{493/6…-933/3…},raft] 144342 + -- stack trace:
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/2{493/6…-933/3…},raft] 144342 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/logstore.(*LogStore).storeEntriesAndCommitBatch
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1197 while storing log entries: during sideloading: ‹replica writer: quorum impossible for batch (0 success + 1 remaining < 2 quorum)›
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1197 +(1) attached stack trace
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1197 + -- stack trace:
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1197 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).handleRaftReadyRaftMuLocked
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1197 + | pkg/kv/kvserver/replica_raft.go:1217
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1197 + | [...repeated from below...]
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1197 +Wraps: (2) while storing log entries
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1197 +Wraps: (3) attached stack trace
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1197 + -- stack trace:
F260913 14:31:15.061688 952 15@kv/kvserver/store_raft.go:767 ⋮ [T1,Vsystem,n2,s2,r1701/3:/Table/113/1/‹2›{‹493›/‹6›…-‹933›/‹3›…},raft] 1197 + | github.com/cockroachdb/cockroach/pkg/kv/kvserver/logstore.(*LogStore).storeEntriesAndCommitBatch
```
Cluster Node to Ip Mapping:

| Node | Public IP | Private IP |
| --- | --- | --- |
| teamcity-21514659-1789279824-256-n4cpu16-0001 | | 10.91.99.226 |
| teamcity-21514659-1789279824-256-n4cpu16-0002 | | 10.91.96.124 |
| teamcity-21514659-1789279824-256-n4cpu16-0003 | | 10.91.100.89 |
| teamcity-21514659-1789279824-256-n4cpu16-0004 | | 10.91.96.182 |

Parameters:
- MetamorphicBasaltMultiAZ=false
- arch=amd64
- cloud=gce
- coverageBuild=false
- cpu=16
- diskCount=0
- encrypted=true
- fs=ext4
- localSSD=false
- runtimeAssertionsBuild=false
- storageNodesVersion=v0.1.19-nightly.20260912
Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md)

See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

See: [Grafana](https://go.crdb.dev/roachtest-grafana/teamcity-21514659/tpccbench-nodes-3-cpu-16-enc-true-binary-basalt-storage-basalt/1789305541392/1789310754305)

_Logs were not uploaded to Datadog_

/cc @cockroachlabs/test-eng

[This test on roachdash](https://roachdash.crdb.dev/?filter=status:open%20t:.*tpccbench/nodes=3/cpu=16/enc=true/binary=basalt/storage=basalt/basalt_nodes=3/rsengine=disabled.*&sort=title+created&display=lastcommented+project) | [Improve this report!](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/bazci/githubpost/issues)

Jira issue: CRDB-68372

Start with the linked TeamCity artifacts and run_132019.359793709_n1_cockroach-workload-f.log, then trace the failure from pkg/kv/kvserver/store_raft.go:767 and pkg/kv/kvserver/replica_raft.go:1217 into logstore.(*LogStore).storeEntriesAndCommitBatch. Identify why sideloading reports an impossible quorum in the three-node basalt tpccbench run, and verify that the roachtest completes without the fatal log entries.

Written by the indexing model from the issue text.