cockroachdb / cockroachdb/cockroach
changefeedccl: log information of messages too large to send
Open
A-cdc
C-enhancement
E-quick-win
T-cdc
- Dominant language
- Go
- Stars
- 32.5k
- Forks
- 4.1k
- PR merge metrics
- PR metrics pending
Description
In the kafka sinks, if the message is to large for the downstream sink, we have a mechanism to reduce the message batch size until either all messages go through or a message size of 1 is too large to send. We should log when this occurs, along with the event's mvcc timestamp and table/row information, to make it easier for users to create new changefeeds that capture the rest of the data without losing any.
Jira issue: CRDB-46570
Contributor guide
Assessment
This issue has not been assessed yet.