apache / apache/paimon

[Bug] how to sync data from mysql to paimon

Open
#1,560 7 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Java
Stars
3.4k
Forks
1.4k
Avg merge
1d 11h
Merged PRs (30d)
396

Description

### Search before asking

- [X] I searched in the [issues](https://github.com/apache/incubator-paimon/issues) and found nothing similar.

### Paimon version

05-SNAPSHOT

### Compute Engine

flink

### Minimal reproduce step

1. run paimon-flink-action.jar
2. use hive to query paimon table
3. could not get data from paimon table

![image](https://github.com/apache/incubator-paimon/assets/8140615/b9ece1d7-52c2-43d3-ba24-640c53c1249c)

I have 8898 rows of data in source mysql table
![image](https://github.com/apache/incubator-paimon/assets/8140615/1a079981-1971-4b18-81e9-5373d473fba6)

BUT there's no data sync into paimon table
![image](https://github.com/apache/incubator-paimon/assets/8140615/f005b401-9a01-4131-b68b-3b07fd5cfae7)

### What doesn't meet your expectations?

I want to get sync data from source mysql table

### Anything else?

_No response_

### Are you willing to submit a PR?

- [X] I'm willing to submit a PR!

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the reported flow with paimon-flink-action.jar: load the MySQL source, query the Paimon table through Hive, and inspect the available screenshots and run details. Done means identifying why the 8,898 source rows are absent and confirming that the rows become visible in the Paimon table.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, mysql
Domain
data-engineering, databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
25/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.