cockroachdb / cockroachdb/cockroach

changefeedccl: automatically replan changefeeds

Open
#124,309 1 comment 0 reactions 0 assignees View on GitHub
A-cdc C-enhancement T-cdc
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

Changefeeds can start to exhibit poor behavior as replicas change the location of the watched data over time. We could do something like the [DR team did and deploy a side car](https://github.com/cockroachdb/cockroach/blob/563369567e594c4bd545ca23e0f2f9c2505fc6a0/pkg/sql/distsql_plan_bulk.go#L212) that monitors potential changes to the plan over time and triggers the changefeed to replan under certain conditions.

Jira issue: CRDB-38817

Contributor guide

Open the contributing guide

Research direction

Start by reading the referenced sidecar implementation in pkg/sql/distsql_plan_bulk.go, especially around the linked line, and then trace how changefeeds construct and maintain their plans. Clarify which replica or plan changes should trigger replanning and how those conditions can be tested. Done means changefeeds automatically replan under agreed conditions without disrupting normal operation.

Written by the indexing model from the issue text.

Assessment

Tech stack
go
Domain
databases, distributed-systems
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.