cockroachdb / cockroachdb/cockroach

rangefeed: client-controlled closed timestamp interval

Open
#114,134 1 comment 0 reactions 0 assignees View on GitHub
A-kv-rangefeed C-performance O-23.2-scale-testing O-testcluster T-kv
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

In large clusters, closed timestamp processing accounts for a large fraction of changefeed resource usage. Often, the changefeed will run with a large checkpoint interval (default `min_checkpoint_frequency = 30s`), but the default rangefeed closed timestamp interval is much smaller (`kv.rangefeed.closed_timestamp_refresh_interval = 3s`), which can produce unnecessary overhead.

It would be convenient if the rangefeed client could request a specific refresh interval, to avoid sending these more often than needed.

This would also be useful for system rangefeeds, that are low-volume but may also want low latency (see e.g. span config updates which are only applied after a checkpoint).

Jira issue: CRDB-33364

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.