[Bug] [Module Name] Caused by: org.apache.seatunnel.engine.common.exception.SeaTunnelEngineException: org.apache.seatunnel.engine.server.checkpoint.CheckpointException: CheckpointCoordinator inside have error.
- Dominant language
- Java
- Stars
- 9.7k
- Forks
- 2.4k
- Avg merge
- 3d 17h
- Merged PRs (30d)
- 210
Description
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
用zeta引擎做数据同步时, 检查点用不了
### SeaTunnel Version
2.3.2
### SeaTunnel Config
```conf
env {
# You can set SeaTunnel environment configuration here
execution.parallelism = 1
job.mode = "STREAMING"
# 10秒检查一次,可以适当加大这个值
execution.checkpoint.interval = 10000
}
# 配置数据源
source {
MySQL-CDC {
# 数据库账号
result_table_name = "result_table_name"
#账号密码
username = ".."
password = "..."
server-id = 3306
# 源表,格式:数据库名.表名
table-names = ["table_name"]
# 数据库连接
base-url = "jdbc:mysql://host:3306/oa_bpm"
# 启动时同步历史数据,然后同步增量数据.(默认是initial)
startup.mode=INITIAL
}
}
transform {
Sql {
source_table_name = "source_table_name"
result_table_name = "result_table_name"
query = "SELECT ID_,TYPE_,TITLE_,CONTENT_,STATUS_,TRY_TIME_,LOG_TIME_,TARGET_,PROC_INST_ID_,TASK_ID_,OWNER_ID_,OWNER_NAME_,YEARS_PARTITION_,now() as stream_data FROM source_bpm_flow_message_log"
}
}
sink {
Doris{
source_table_name = "source_table_name"
fenodes = "host:8030"
username = ".."
password = ".."
table.identifier = "tmp.bpm_flow_message_log_transfer"
sink.enable-2pc = true
sink.label-prefix = "prefix_name_202308041422"
doris.config = {
format = "json"
read_json_by_line = "true"
}
}
}
```
### Running Command
```shell
./seatunnel.sh --config ./conf/test.config -s jobid
./seatunnel.sh --config ./conf/test.config -r jobid
```
### Error Exception
```log
Caused by: org.apache.seatunnel.engine.common.exception.SeaTunnelEngineException: org.apache.seatunnel.engine.server.checkpoint.CheckpointException: CheckpointCoordinator inside have error.
```
### Zeta or Flink or Spark Version
_No response_
### Java or Scala Version
_No response_
### Screenshots
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
Contributor guide
No contributing guide indexed for this repository
Research direction
Start by reproducing the streaming MySQL-CDC to Doris configuration with SeaTunnel 2.3.2 and capture the complete checkpoint exception stack trace; the issue does not name a source file or test. Trace the CheckpointCoordinator failure through the engine checkpoint code and confirm the cause with a focused regression test or documented reproduction before considering the issue done.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- java, mysql
- Domain
- data-engineering, databases, distributed-systems
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 35/100