confluentinc / confluentinc/examples

partitions mismatch for pageview

Open
#647 8 comments 0 reactions 0 assignees View on GitHub
Dominant language
Java
Stars
2.1k
Forks
1.1k
PR merge metrics
No merged PRs in 30d

Description

the pageviews topic is autocreated by the connector in the onprem cluster with 1 partition and replicated to ccloud with one partition. C/Cloud default partition count is six.

Thus a subsequent JOIN attempt fails:
{"@type":"statement_error","error_code":40001,"message":"Can't join PAGEVIEWS_ORIGINAL with USERS_ORIGINAL since the number of partitions don't match. PAGEVIEWS_ORIGINAL partitions = 1; USERS_ORIGINAL partitions = 6. Please repartition either one so that the number of partitions match."

AFAIK the partition count cannot be set in the Replicator (awaiting https://cwiki.apache.org/confluence/display/KAFKA/KIP-158)
so the topic must be pre-created in the on-prem cluster.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.