apache / apache/paimon

kafka-cdc正库同步为每张表添加指定分区分桶功能。

Open
#3,516 2 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Java
Stars
3.4k
Forks
1.4k
Avg merge
1d 11h
Merged PRs (30d)
396

Description

### Search before asking

- [X] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar.

### Motivation

目前paimon-cdc在整库同步时不能够为每张表设置分区及分桶的策略;导致有分区分桶表需求时,只能使用单表同步,希望在正库同步时候能够为每张表设置不同的分区及分桶策略。

### Solution

_No response_

### Anything else?

_No response_

### Are you willing to submit a PR?

- [X] I'm willing to submit a PR!

Contributor guide

No contributing guide indexed for this repository

Research direction

No implementation file, test, or concrete configuration format is identified. Start by tracing Kafka CDC whole-database synchronization and the existing single-table partition and bucket configuration. Done should mean each table in a whole-database sync can receive its own partition and bucket strategy, with coverage for differing table configurations.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, kafka
Domain
data-engineering, databases
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.