apache / apache/paimon

[Bug] kafka_sync_database can only auto create one table per topic.

Open
#7,581 0 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Java
Stars
3.4k
Forks
1.4k
Avg merge
1d 11h
Merged PRs (30d)
396

Description

### Search before asking

- [x] I searched in the [issues](https://github.com/apache/paimon/issues) and found nothing similar.

### Paimon version

paimon-flink-1.20-1.2.0.jar

### Compute Engine

flink-dist-1.20.3.jar

### Minimal reproduce step

Using an empty warehouse and database: When consuming a topic with multiple tables, only one table is automatically created; the others will report a non-existent error. If the other tables are created manually, the task will execute normally.

### What doesn't meet your expectations?

If each topic has only one table, the task can be executed normally, and all tables will be created automatically.

### Anything else?

Does a parameter exist that can handle a single topic (containing multiple tables) and automatically create all tables?

### Are you willing to submit a PR?

- [ ] I'm willing to submit a PR!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing kafka_sync_database with an empty warehouse and database, using one topic containing multiple tables. Trace why only one table is auto-created while the others report as nonexistent; done means all tables are created automatically and the task executes without manually creating them.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, kafka
Domain
data-engineering
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.