cockroachdb / cockroachdb/cockroach
changefeedccl: leverage kafka data loss detection to perform some action, such as replaying the changefeed from the last known good point
Open
A-cdc
C-enhancement
T-cdc
- Dominant language
- Go
- Stars
- 32.5k
- Forks
- 4.1k
- PR merge metrics
- PR metrics pending
Description
franz-go, the kafka library powering our v2 kafka sink, has the ability to detect unavoidable data loss due to kafka-side operational issues. when this happens, we currently (in the v2 sink) warn. we should instead try to mitigate the data loss by replaying messages.
Jira issue: CRDB-40338
Contributor guide
Assessment
This issue has not been assessed yet.