apache / apache/seatunnel

Tables synced from MySQL to Doris lack both column comments and table comments.

Open
#11,969 2 comments 0 reactions 0 assignees View on GitHub
bug
Dominant language
Java
Stars
9.7k
Forks
2.4k
Avg merge
3d 9h
Merged PRs (30d)
204

Description

### Search before asking

- [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.

### What happened

通过seatunnel 2.3.13 数据同步, mysql jdbc同步到doris 丢失了字段注释和表注释

### SeaTunnel Version

seatunnel 2.3.13

### SeaTunnel Config

```conf
env {
parallelism = 1
job.mode = "BATCH"
}
source {
Jdbc {
url = "jdbc:mysql://10.201.26.13:3306?useSSL=false&useUnicode=true&tinyInt1isBit=false&characterEncoding=UTF-8&useInformationSchema=true"
driver = "com.mysql.cj.jdbc.Driver"
connection_check_timeout_sec = 100
user = "root"
password = "xxxxxx"
query = "select * from xxxx.report"

}
}

sink {
Doris {
fenodes = "10.101.20.220:8030"
username = "root"
password = "xxxxx"
database = "xxx"
table = "report"
sink.label-prefix = "test-cdc"
doris.config = {
format = "json"
read_json_by_line="true"
}
}
}
```

### Running Command

```shell
./bin/seatunnel.sh --config ./job/mysql_jdbc_doris.conf -m local
```

### Error Exception

```log
mysql jdbc同步到doris 丢失了字段注释和表注释
```

### Zeta or Flink or Spark Version

_No response_

### Java or Scala Version

_No response_

### Screenshots

Image

### Are you willing to submit PR?

- [ ] Yes I am willing to submit a PR!

### Code of Conduct

- [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)

Contributor guide

No contributing guide indexed for this repository

Research direction

The issue provides job/mysql_jdbc_doris.conf and the local ./bin/seatunnel.sh command; first reproduce the MySQL-to-Doris batch sync with that configuration and inspect how schema metadata is transferred. Done means both column comments and the table comment are retained in Doris.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, mysql
Domain
data-engineering, databases
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Needs clarification
Newbie friendliness
45/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.