cockroachdb / cockroachdb/cockroach

changefeedccl: leverage kafka data loss detection to perform some action, such as replaying the changefeed from the last known good point

Open
#127,246 1 comment 0 reactions 0 assignees View on GitHub
A-cdc C-enhancement T-cdc
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

franz-go, the kafka library powering our v2 kafka sink, has the ability to detect unavoidable data loss due to kafka-side operational issues. when this happens, we currently (in the v2 sink) warn. we should instead try to mitigate the data loss by replaying messages.

Jira issue: CRDB-40338

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.