cockroachdb / cockroachdb/cockroach
changefeedccl: investigate whether the kafka resizing behaviour is correct
Open
A-cdc
C-investigation
T-cdc
- Dominant language
- Go
- Stars
- 32.5k
- Forks
- 4.1k
- PR merge metrics
- PR metrics pending
Description
For both the v1 and v2 sinks, we check for a MessageTooLarge error, which according to the kafka docs seems like it would indicate a single message being too large. Perhaps we should be using RecordListTooLarge.
Jira issue: CRDB-40418
Contributor guide
Research direction
Trace the v1 and v2 sink handling for Kafka's MessageTooLarge error, then compare that behavior with the Kafka documentation and the RecordListTooLarge error mentioned here. Done means determining whether the resizing behavior is correct and documenting whether the error check should change.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go, kafka
- Domain
- stream-processing
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100