apache / apache/paimon

[Feature] cdc support regular expression match database name

Open
#1,590 3 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Java
Stars
3.4k
Forks
1.4k
Avg merge
1d 11h
Merged PRs (30d)
396

Description

### Search before asking

- [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar.

### Motivation

Sync mysql database to paimon by flink cdc in paimon flink action, support the regular expression match to filter database name. Sync all the tables that database match the regex and tablename match the regex.

### Solution

_No response_

### Anything else?

_No response_

### Are you willing to submit a PR?

- [ ] I'm willing to submit a PR!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start in the Paimon Flink action's MySQL CDC configuration and filtering entry points, then trace how table-name regular expressions are applied. Done means database names can also be filtered by regular expression and synchronization includes only tables whose database and table names match.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, mysql
Domain
data-engineering, databases
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.