confluentinc / confluentinc/examples
partitions mismatch for pageview
- Dominant language
- Java
- Stars
- 2.1k
- Forks
- 1.1k
- PR merge metrics
- No merged PRs in 30d
Description
the pageviews topic is autocreated by the connector in the onprem cluster with 1 partition and replicated to ccloud with one partition. C/Cloud default partition count is six.
Thus a subsequent JOIN attempt fails:
{"@type":"statement_error","error_code":40001,"message":"Can't join PAGEVIEWS_ORIGINAL with USERS_ORIGINAL since the number of partitions don't match. PAGEVIEWS_ORIGINAL partitions = 1; USERS_ORIGINAL partitions = 6. Please repartition either one so that the number of partitions match."
AFAIK the partition count cannot be set in the Replicator (awaiting https://cwiki.apache.org/confluence/display/KAFKA/KIP-158)
so the topic must be pre-created in the on-prem cluster.
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.