cockroachdb / cockroachdb/cockroach

changefeedccl: investigate whether the kafka resizing behaviour is correct

Open
#127,379 2 comments 0 reactions 0 assignees View on GitHub
A-cdc C-investigation T-cdc
Dominant language
Go
Stars
32.5k
Forks
4.1k
PR merge metrics
PR metrics pending

Description

For both the v1 and v2 sinks, we check for a MessageTooLarge error, which according to the kafka docs seems like it would indicate a single message being too large. Perhaps we should be using RecordListTooLarge.

Jira issue: CRDB-40418

Contributor guide

Open the contributing guide

Research direction

Trace the v1 and v2 sink handling for Kafka's MessageTooLarge error, then compare that behavior with the Kafka documentation and the RecordListTooLarge error mentioned here. Done means determining whether the resizing behavior is correct and documenting whether the error check should change.

Written by the indexing model from the issue text.

Assessment

Tech stack
go, kafka
Domain
stream-processing
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.