cockroachdb / cockroachdb/cockroach

Sentry: resolved_timestamp.go:292: log.Fatal: resolved timestamp 1751855425.487050576,0 equal to or above timestamp of operation × (1) attached stack trace -- stack trace: | github.com/cockroachd...

Open
#149,577 1 comment 0 reactions 0 assignees View on GitHub
branch-release-25.1 C-bug O-sentry T-kv X-blathers-triaged
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

This issue was auto filed by Sentry. It represents a crash or reported error on a live cluster with telemetry enabled.

Sentry Link: [https://cockroach-labs.sentry.io/issues/6730655178/?referrer=webhooks_plugin](https://cockroach-labs.sentry.io/issues/6730655178/?referrer=webhooks_plugin)

Panic Message:

```
resolved_timestamp.go:292: log.Fatal: resolved timestamp 1751855425.487050576,0 equal to or above timestamp of operation ×
(1) attached stack trace
-- stack trace:
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*resolvedTimestamp).assertOpAboveRTS
| pkg/kv/kvserver/rangefeed/resolved_timestamp.go:292
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*resolvedTimestamp).consumeLogicalOp
| pkg/kv/kvserver/rangefeed/resolved_timestamp.go:169
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*resolvedTimestamp).ConsumeLogicalOp
| pkg/kv/kvserver/rangefeed/resolved_timestamp.go:140
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*ScheduledProcessor).consumeLogicalOps
| pkg/kv/kvserver/rangefeed/scheduled_processor.go:749
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*ScheduledProcessor).consumeEvent
| pkg/kv/kvserver/rangefeed/scheduled_processor.go:687
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*ScheduledProcessor).processEvents
| pkg/kv/kvserver/rangefeed/scheduled_processor.go:202
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*ScheduledProcessor).process
| pkg/kv/kvserver/rangefeed/scheduled_processor.go:157
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*schedulerShard).processEvents
| pkg/kv/kvserver/rangefeed/scheduler.go:492
| github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Scheduler).Start.func1
| pkg/kv/kvserver/rangefeed/scheduler.go:249
| github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2
| pkg/util/stop/stopper.go:498
| runtime.goexit
| src/runtime/asm_amd64.s:1695
Wraps: (2) secondary error attachment
| resolved timestamp 1751855425.487050576,0 equal to or above timestamp of operation ×
| (1) assertion failure
| Wraps: (2) attached stack trace
| -- stack trace:
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*resolvedTimestamp).assertOpAboveRTS
| | pkg/kv/kvserver/rangefeed/resolved_timestamp.go:289
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*resolvedTimestamp).consumeLogicalOp
| | pkg/kv/kvserver/rangefeed/resolved_timestamp.go:169
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*resolvedTimestamp).ConsumeLogicalOp
| | pkg/kv/kvserver/rangefeed/resolved_timestamp.go:140
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*ScheduledProcessor).consumeLogicalOps
| | pkg/kv/kvserver/rangefeed/scheduled_processor.go:749
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*ScheduledProcessor).consumeEvent
| | pkg/kv/kvserver/rangefeed/scheduled_processor.go:687
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*ScheduledProcessor).processEvents
| | pkg/kv/kvserver/rangefeed/scheduled_processor.go:202
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*ScheduledProcessor).process
| | pkg/kv/kvserver/rangefeed/scheduled_processor.go:157
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*schedulerShard).processEvents
| | pkg/kv/kvserver/rangefeed/scheduler.go:492
| | github.com/cockroachdb/cockroach/pkg/kv/kvserver/rangefeed.(*Scheduler).Start.func1
| | pkg/kv/kvserver/rangefeed/scheduler.go:249
| | github.com/cockroachdb/cockroach/pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2
| | pkg/util/stop/stopper.go:498
| | runtime.goexit
| | src/runtime/asm_amd64.s:1695
| Wraps: (3) resolved timestamp 1751855425.487050576,0 equal to or above timestamp of operation ×
| Error types: (1) *assert.withAssertionFailure (2) *withstack.withStack (3) *errutil.leafError
Wraps: (3) log.Fatal: resolved timestamp 1751855425.487050576,0 equal to or above timestamp of operation ×
Error types: (1) *withstack.withStack (2) *secondary.withSecondaryError (3) *errutil.leafError
-- report composition:
*errutil.leafError: log.Fatal: resolved timestamp 1751855425.487050576,0 equal to or above timestamp of operation ×
*secondary.withSecondaryError: details for github.com/cockroachdb/errors/withstack/*withstack.withStack:::
resolved_timestamp.go:292: *withstack.withStack (top exception)
```

Stacktrace (expand for inline code snippets):

[src/runtime/asm_amd64.s#L1694-L1696](src/runtime/asm_amd64.s#L1694-L1696)
[pkg/util/stop/stopper.go#L497-L499](pkg/util/stop/stopper.go#L497-L499)
[pkg/kv/kvserver/rangefeed/scheduler.go#L248-L250](pkg/kv/kvserver/rangefeed/scheduler.go#L248-L250)
[pkg/kv/kvserver/rangefeed/scheduler.go#L491-L493](pkg/kv/kvserver/rangefeed/scheduler.go#L491-L493)
[pkg/kv/kvserver/rangefeed/scheduled_processor.go#L156-L158](pkg/kv/kvserver/rangefeed/scheduled_processor.go#L156-L158)
[pkg/kv/kvserver/rangefeed/scheduled_processor.go#L201-L203](pkg/kv/kvserver/rangefeed/scheduled_processor.go#L201-L203)
[pkg/kv/kvserver/rangefeed/scheduled_processor.go#L686-L688](pkg/kv/kvserver/rangefeed/scheduled_processor.go#L686-L688)
[pkg/kv/kvserver/rangefeed/scheduled_processor.go#L748-L750](pkg/kv/kvserver/rangefeed/scheduled_processor.go#L748-L750)
[pkg/kv/kvserver/rangefeed/resolved_timestamp.go#L139-L141](pkg/kv/kvserver/rangefeed/resolved_timestamp.go#L139-L141)
[pkg/kv/kvserver/rangefeed/resolved_timestamp.go#L168-L170](pkg/kv/kvserver/rangefeed/resolved_timestamp.go#L168-L170)
[pkg/kv/kvserver/rangefeed/resolved_timestamp.go#L291-L293](pkg/kv/kvserver/rangefeed/resolved_timestamp.go#L291-L293)

```
src/runtime/asm_amd64.s in runtime.goexit at line 1695
pkg/util/stop/stopper.go in pkg/util/stop.(*Stopper).RunAsyncTaskEx.func2 at line 498
pkg/kv/kvserver/rangefeed/scheduler.go in pkg/kv/kvserver/rangefeed.(*Scheduler).Start.func1 at line 249
pkg/kv/kvserver/rangefeed/scheduler.go in pkg/kv/kvserver/rangefeed.(*schedulerShard).processEvents at line 492
pkg/kv/kvserver/rangefeed/scheduled_processor.go in pkg/kv/kvserver/rangefeed.(*ScheduledProcessor).process at line 157
pkg/kv/kvserver/rangefeed/scheduled_processor.go in pkg/kv/kvserver/rangefeed.(*ScheduledProcessor).processEvents at line 202
pkg/kv/kvserver/rangefeed/scheduled_processor.go in pkg/kv/kvserver/rangefeed.(*ScheduledProcessor).consumeEvent at line 687
pkg/kv/kvserver/rangefeed/scheduled_processor.go in pkg/kv/kvserver/rangefeed.(*ScheduledProcessor).consumeLogicalOps at line 749
pkg/kv/kvserver/rangefeed/resolved_timestamp.go in pkg/kv/kvserver/rangefeed.(*resolvedTimestamp).ConsumeLogicalOp at line 140
pkg/kv/kvserver/rangefeed/resolved_timestamp.go in pkg/kv/kvserver/rangefeed.(*resolvedTimestamp).consumeLogicalOp at line 169
pkg/kv/kvserver/rangefeed/resolved_timestamp.go in pkg/kv/kvserver/rangefeed.(*resolvedTimestamp).assertOpAboveRTS at line 292
```

### Tags

| Tag | Value |
| --- | --- |
| Command | server |
| Environment | v25.1.6 |
| Go Version | go1.22.8 X:nocoverageredesign |
| Platform | linux amd64 |
| Distribution | CCL |
| Cockroach Release | v25.1.6 |
| Cockroach SHA | 9af34db410ad57b58a35d8251d7c4fe1ddfcec69 |
| # of CPUs | 2 |
| # of Goroutines | 502 |

Jira issue: CRDB-52214

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.