apache / apache/seatunnel

[Bug] [Module Name] Caused by: org.apache.seatunnel.engine.common.exception.SeaTunnelEngineException: org.apache.seatunnel.engine.server.checkpoint.CheckpointException: CheckpointCoordinator inside have error.

Open
#5,396 12 comments 0 reactions 0 assignees View on GitHub
bug Waiting for users feedback
Dominant language
Java
Stars
9.7k
Forks
2.4k
Avg merge
3d 17h
Merged PRs (30d)
210

Description

### Search before asking

- [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.

### What happened

用zeta引擎做数据同步时, 检查点用不了

### SeaTunnel Version

2.3.2

### SeaTunnel Config

```conf
env {
# You can set SeaTunnel environment configuration here
execution.parallelism = 1
job.mode = "STREAMING"
# 10秒检查一次,可以适当加大这个值
execution.checkpoint.interval = 10000
}

# 配置数据源
source {
MySQL-CDC {
# 数据库账号
result_table_name = "result_table_name"
#账号密码
username = ".."
password = "..."
server-id = 3306
# 源表,格式:数据库名.表名
table-names = ["table_name"]
# 数据库连接
base-url = "jdbc:mysql://host:3306/oa_bpm"
# 启动时同步历史数据,然后同步增量数据.(默认是initial)
startup.mode=INITIAL
}
}

transform {
Sql {
source_table_name = "source_table_name"
result_table_name = "result_table_name"
query = "SELECT ID_,TYPE_,TITLE_,CONTENT_,STATUS_,TRY_TIME_,LOG_TIME_,TARGET_,PROC_INST_ID_,TASK_ID_,OWNER_ID_,OWNER_NAME_,YEARS_PARTITION_,now() as stream_data FROM source_bpm_flow_message_log"
}
}

sink {
Doris{
source_table_name = "source_table_name"
fenodes = "host:8030"
username = ".."
password = ".."
table.identifier = "tmp.bpm_flow_message_log_transfer"
sink.enable-2pc = true
sink.label-prefix = "prefix_name_202308041422"
doris.config = {
format = "json"
read_json_by_line = "true"
}
}
}
```

### Running Command

```shell
./seatunnel.sh --config ./conf/test.config -s jobid
./seatunnel.sh --config ./conf/test.config -r jobid
```

### Error Exception

```log
Caused by: org.apache.seatunnel.engine.common.exception.SeaTunnelEngineException: org.apache.seatunnel.engine.server.checkpoint.CheckpointException: CheckpointCoordinator inside have error.
```

### Zeta or Flink or Spark Version

_No response_

### Java or Scala Version

_No response_

### Screenshots

_No response_

### Are you willing to submit PR?

- [ ] Yes I am willing to submit a PR!

### Code of Conduct

- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)

Contributor guide

No contributing guide indexed for this repository

Research direction

Start by reproducing the streaming MySQL-CDC to Doris configuration with SeaTunnel 2.3.2 and capture the complete checkpoint exception stack trace; the issue does not name a source file or test. Trace the CheckpointCoordinator failure through the engine checkpoint code and confirm the cause with a focused regression test or documented reproduction before considering the issue done.

Written by the indexing model from the issue text.

Assessment

Tech stack
java, mysql
Domain
data-engineering, databases, distributed-systems
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.