cockroachdb / cockroachdb/cockroach

changefeedccl: add frontier history and visualizer

Open
#154,669 1 comment 0 reactions 0 assignees View on GitHub
A-cdc C-enhancement T-cdc
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

- Add a component that periodically snapshots the whole frontier and stores the last N of them in a ring buffer, and have it dump this as part of debug zips / on command.

- Add a visualizer tool/script that can parse that information to visualize both individual frontiers (which spans have made what progress, etc) and the collected timeline of them.

Together these can help us visualize how changefeed progress is made and potentially help diagnose issues.

Jira issue: CRDB-55068

Contributor guide

Open the contributing guide

Research direction

Start by locating the changefeed frontier implementation and the existing debug-zip or command output paths. Then determine how frontier snapshots and their retention should connect to a visualizer tool or script. Done means the requested frontier history is captured and exposed, and individual frontiers plus their timeline can be visualized.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
distributed-systems
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.