cockroachdb / cockroachdb/cockroach

changefeedccl: add observability for changefeed catchup progress

Open
#147,661 3 comments 0 reactions 0 assignees View on GitHub
A-cdc C-enhancement O-support P-3 T-cdc
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

When a changefeed is catching up after a long period of lag, it can be difficult to identify progress. We have `distsender.rangefeed.catchup_ranges` that shows the number of ranges in catch up mode, but completing ranges can be bursty depending on the number of writes that need to be emitted. `changefeed.emitted.messages` shows that a given changefeed is sending messages and thus making progress, but doesn't provide a sense of how many messages have been processed so far and how many more are expected before the catchup is complete. It would be useful to have a metric (or other observability) that indicates the progress of the catchup period.

Jira issue: CRDB-51182

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.