cockroachdb / cockroachdb/cockroach

Sentry: replica_closedts.go:295: log.Fatal: side-transport update saw closed timestamp regression on r31: (lai=20, ts=1763761329.700019477,0) -> (lai=10, ts=1763761329.989224715,0) (1) attached stack ...

Open
#158,221 1 comment 0 reactions 0 assignees View on GitHub
branch-release-25.3 C-bug O-sentry T-kv X-blathers-triaged
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

This issue was auto filed by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.

Sentry Link: [https://cockroach-labs.sentry.io/issues/7052448100/?referrer=webhooks_plugin](https://cockroach-labs.sentry.io/issues/7052448100/?referrer=webhooks_plugin)

Panic Message:

```
replica_closedts.go:295: log.Fatal: side-transport update saw closed timestamp regression on r31: (lai=20, ts=1763761329.700019477,0) -> (lai=10, ts=1763761329.989224715,0)
(1) attached stack trace
-- stack trace:
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*sidetransportAccess).assertNoRegression
| pkg/kv/kvserver/replica_closedts.go:295
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*sidetransportAccess).forward
| pkg/kv/kvserver/replica_closedts.go:272
| github.com/cockroachdb/cockroach/pkg/kv/kvserver.(*Replica).BumpSideTransportClosed
| pkg/kv/kvserver/replica_closedts.go:141
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/closedts/sidetransport.(*Sender).publish
| pkg/kv/kvserver/closedts/sidetransport/sender.go:398
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/closedts/sidetransport.(*Sender).Run.func2
| pkg/kv/kvserver/closedts/sidetransport/sender.go:261
| github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func1
| pkg/util/stop/stopper.go:438
| runtime.goexit
| src/runtime/asm_amd64.s:1700
Wraps: (2) log.Fatal: side-transport update saw closed timestamp regression on r31: (lai=20, ts=1763761329.700019477,0) -> (lai=10, ts=1763761329.989224715,0)
Error types: (1) *withstack.withStack (2) *errutil.leafError
-- report composition:
*errutil.leafError: log.Fatal: side-transport update saw closed timestamp regression on r31: (lai=20, ts=1763761329.700019477,0) -> (lai=10, ts=1763761329.989224715,0)
replica_closedts.go:295: *withstack.withStack (top exception)
```

Stacktrace (expand for inline code snippets):

[src/runtime/asm_amd64.s#L1699-L1701](src/runtime/asm_amd64.s#L1699-L1701)
[pkg/util/stop/stopper.go#L437-L439](pkg/util/stop/stopper.go#L437-L439)
[pkg/kv/kvserver/closedts/sidetransport/sender.go#L260-L262](pkg/kv/kvserver/closedts/sidetransport/sender.go#L260-L262)
[pkg/kv/kvserver/closedts/sidetransport/sender.go#L397-L399](pkg/kv/kvserver/closedts/sidetransport/sender.go#L397-L399)
[pkg/kv/kvserver/replica_closedts.go#L140-L142](pkg/kv/kvserver/replica_closedts.go#L140-L142)
[pkg/kv/kvserver/replica_closedts.go#L271-L273](pkg/kv/kvserver/replica_closedts.go#L271-L273)
[pkg/kv/kvserver/replica_closedts.go#L294-L296](pkg/kv/kvserver/replica_closedts.go#L294-L296)

```
src/runtime/asm_amd64.s in runtime.goexit at line 1700
pkg/util/stop/stopper.go in pkg/util/stop.(*Stopper).RunAsyncTaskEx.func1 at line 438
pkg/kv/kvserver/closedts/sidetransport/sender.go in pkg/kv/kvserver/closedts/sidetransport.(*Sender).Run.func2 at line 261
pkg/kv/kvserver/closedts/sidetransport/sender.go in pkg/kv/kvserver/closedts/sidetransport.(*Sender).publish at line 398
pkg/kv/kvserver/replica_closedts.go in pkg/kv/kvserver.(*Replica).BumpSideTransportClosed at line 141
pkg/kv/kvserver/replica_closedts.go in pkg/kv/kvserver.(*sidetransportAccess).forward at line 272
pkg/kv/kvserver/replica_closedts.go in pkg/kv/kvserver.(*sidetransportAccess).assertNoRegression at line 295
```

### Tags

| Tag | Value |
| --- | --- |
| Command | server |
| Environment | v25.3.4 |
| Go Version | go1.23.12 X:nocoverageredesign |
| Platform | linux amd64 |
| Distribution | CCL |
| Cockroach Release | v25.3.4 |
| Cockroach SHA | 1cddb3a22695e967197844b214115eb645473efe |
| # of CPUs | 4 |
| # of Goroutines | 445 |

Jira issue: CRDB-57168

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.