apache / apache/seatunnel

[Bug] [Postgress-CDC] Postgress-CDC NullPointerException

Open
#9,798 5 comments 1 reaction 1 assignee Claimed by @liujishui87 View on GitHub
bug needs-info
Dominant language
Java
Stars
9.7k
Forks
2.4k
Avg merge
3d 13h
Merged PRs (30d)
203

Description

### Search before asking

- [x] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.

### What happened

Null pointer problem occurs during execution

### SeaTunnel Version

2.3.12-SNAPSHOT

### SeaTunnel Config

```conf
env {
# You can set engine configuration here
execution.parallelism = 1
job.mode = "STREAMING"
checkpoint.interval = 5000
}

source {
Postgres-CDC {
username = "postgres"
password = "****"
database-names = ["test"]
table-names = ["test.public.test_meter"]
schema-names = ["public"]
startup.mode = "initial"
slot.name = "seatunnel_slot"
url = "jdbc:postgresql://127.0.0.1:5432/postgres?loggerLevel=OFF"
}
}

sink {
Doris {
fenodes = "192.168.200.181:8030"
username = "root"
password = "***"
database = "test"
table = "test_meter"
sink.label-prefix = "test-cdc"
sink.enable-2pc = "true"
sink.enable-delete = "true"
sink.max-retries = 3
doris.config = {
format = "json"
read_json_by_line="true"
}
}
}
```

### Running Command

```shell
None
```

### Error Exception

```log
Caused by: io.debezium.DebeziumException: java.lang.NullPointerException
at org.apache.seatunnel.connectors.seatunnel.cdc.postgres.source.reader.snapshot.PostgresSnapshotSplitReadTask.execute(PostgresSnapshotSplitReadTask.java:112)
at org.apache.seatunnel.connectors.seatunnel.cdc.postgres.source.reader.snapshot.PostgresSnapshotFetchTask.execute(PostgresSnapshotFetchTask.java:65)
at org.apache.seatunnel.connectors.cdc.base.source.reader.external.IncrementalSourceScanFetcher.lambda$submitTask$0(IncrementalSourceScanFetcher.java:96)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run$$$capture(FutureTask.java:266)
at java.util.concurrent.FutureTask.run(FutureTask.java)
at --- Async.Stack.Trace --- (captured by IntelliJ IDEA debugger)
at java.util.concurrent.FutureTask.(FutureTask.java:151)
at java.util.concurrent.AbstractExecutorService.newTaskFor(AbstractExecutorService.java:87)
at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:111)
at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678)
at org.apache.seatunnel.connectors.cdc.base.source.reader.external.IncrementalSourceScanFetcher.submitTask(IncrementalSourceScanFetcher.java:89)
at org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceSplitReader.checkSplitOrStartNext(IncrementalSourceSplitReader.java:147)
at org.apache.seatunnel.connectors.cdc.base.source.reader.IncrementalSourceSplitReader.fetch(IncrementalSourceSplitReader.java:71)
... 28 more
Caused by: java.lang.NullPointerException
at org.apache.seatunnel.connectors.seatunnel.cdc.postgres.source.reader.snapshot.PostgresSnapshotSplitReadTask.createDataEventsForTable(PostgresSnapshotSplitReadTask.java:183)
at org.apache.seatunnel.connectors.seatunnel.cdc.postgres.source.reader.snapshot.PostgresSnapshotSplitReadTask.createDataEvents(PostgresSnapshotSplitReadTask.java:170)
at org.apache.seatunnel.connectors.seatunnel.cdc.postgres.source.reader.snapshot.PostgresSnapshotSplitReadTask.doExecute(PostgresSnapshotSplitReadTask.java:136)
at org.apache.seatunnel.connectors.seatunnel.cdc.postgres.source.reader.snapshot.PostgresSnapshotSplitReadTask.execute(PostgresSnapshotSplitReadTask.java:107)
... 41 more
```

### Zeta or Flink or Spark Version

_No response_

### Java or Scala Version

java 8

### Screenshots

Image

Image

Image

### Are you willing to submit PR?

- [x] #10057

### Code of Conduct

- [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.