Postgress source issue running incremental CDC sync fails with ERROR debezium-postgresconnector-sa-change-event-source-coordinator i.d.u.Loggings(logErrorAndTraceRecord):58 Failed
- Ngôn ngữ chính
- Python
- Star
- 22.1k
- Fork
- 5.4k
- Merge trung bình
- 5 giờ
- Pull request đã merge (30 ngày)
- 671
Mô tả
### Connector Name
Postgres
### Connector Version
3.6.18
### What step the error happened?
During the sync
### Relevant information
CDC has stopped loading any records but does not fail.
Checking the logs is has multiple errors:
source ERROR debezium-postgresconnector-sa-change-event-source-coordinator i.d.u.Loggings(logErrorAndTraceRecord):58 Failed to properly convert data value for 'public.content_audience_records.createdAt' of type timestamp org.apache.kafka.connect.errors.DataException: Invalid Java object for schema with type STRING: class java.lang.Long for field: "createdAt"
if i do a 'Refresh data' it passes AND loads data, then the first run stoppes after 14 ish minutes with success but 0 loaded, then checking the log we get the above LOTS of time
### Relevant log output
```shell
2026-01-20 18:05:26 error ERROR debezium-postgresconnector-sa-change-event-source-coordinator i.d.u.Loggings(logErrorAndTraceRecord):58 Failed to properly convert data value for 'public.content_audience_records.createdAt' of type timestamp org.apache.kafka.connect.errors.DataException: Invalid Java object for schema with type STRING: class java.lang.Long for field: "createdAt"
at org.apache.kafka.connect.data.ConnectSchema.validateValue(ConnectSchema.java:242) ~[connect-api-3.7.0.jar:?]
at org.apache.kafka.connect.data.Struct.put(Struct.java:216) ~[connect-api-3.7.0.jar:?]
at io.debezium.relational.TableSchemaBuilder.lambda$createValueGenerator$5(TableSchemaBuilder.java:298) ~[debezium-core-2.6.2.Final.jar:2.6.2.Final]
at io.debezium.relational.TableSchema.valueFromColumnData(TableSchema.java:141) ~[debezium-core-2.6.2.Final.jar:2.6.2.Final]
at io.debezium.relational.RelationalChangeRecordEmitter.emitDeleteRecord(RelationalChangeRecordEmitter.java:136) ~[debezium-core-2.6.2.Final.jar:2.6.2.Final]
at io.debezium.relational.RelationalChangeRecordEmitter.emitChangeRecords(RelationalChangeRecordEmitter.java:56) ~[debezium-core-2.6.2.Final.jar:2.6.2.Final]
at io.debezium.connector.postgresql.PostgresChangeRecordEmitter.emitChangeRecords(PostgresChangeRecordEmitter.java:94) ~[debezium-connector-postgres-2.6.2.Final.jar:2.6.2.Final]
at io.debezium.pipeline.EventDispatcher.dispatchDataChangeEvent(EventDispatcher.java:271) ~[debezium-core-2.6.2.Final.jar:2.6.2.Final]
at io.debezium.connector.postgresql.PostgresStreamingChangeEventSource.processReplicationMessages(PostgresStreamingChangeEventSource.java:315) ~[debezium-connector-postgres-2.6.2.Final.jar:2.6.2.Final]
at io.debezium.connector.postgresql.PostgresStreamingChangeEventSource.lambda$processMessages$0(PostgresStreamingChangeEventSource.java:217) ~[debezium-connector-postgres-2.6.2.Final.jar:2.6.2.Final]
at io.debezium.connector.postgresql.connection.pgoutput.PgOutputMessageDecoder.decodeDelete(PgOutputMessageDecoder.java:512) ~[debezium-connector-postgres-2.6.2.Final.jar:2.6.2.Final]
at io.debezium.connector.postgresql.connection.pgoutput.PgOutputMessageDecoder.processNotEmptyMessage(PgOutputMessageDecoder.java:214) ~[debezium-connector-postgres-2.6.2.Final.jar:2.6.2.Final]
at io.debezium.connector.postgresql.connection.AbstractMessageDecoder.processMessage(AbstractMessageDecoder.java:41) ~[debezium-connector-postgres-2.6.2.Final.jar:2.6.2.Final]
at io.debezium.connector.postgresql.connection.PostgresReplicationConnection$1.deserializeMessages(PostgresReplicationConnection.java:642) ~[debezium-connector-postgres-2.6.2.Final.jar:2.6.2.Final]
at io.debezium.connector.postgresql.connection.PostgresReplicationConnection$1.readPending(PostgresReplicationConnection.java:634) ~[debezium-connector-postgres-2.6.2.Final.jar:2.6.2.Final]
at io.debezium.connector.postgresql.PostgresStreamingChangeEventSource.processMessages(PostgresStreamingChangeEventSource.java:217) ~[debezium-connector-postgres-2.6.2.Final.jar:2.6.2.Final]
at io.debezium.connector.postgresql.PostgresStreamingChangeEventSource.execute(PostgresStreamingChangeEventSource.java:179) ~[debezium-connector-postgres-2.6.2.Final.jar:2.6.2.Final]
at io.debezium.connector.postgresql.PostgresStreamingChangeEventSource.execute(PostgresStreamingChangeEventSource.java:42) ~[debezium-connector-postgres-2.6.2.Final.jar:2.6.2.Final]
at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:280) ~[debezium-core-2.6.2.Final.jar:2.6.2.Final]
at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:197) ~[debezium-core-2.6.2.Final.jar:2.6.2.Final]
at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:140) ~[debezium-core-2.6.2.Final.jar:2.6.2.Final]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572) ~[?:?]
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317) ~[?:?]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
at java.base/java.lang.Thread.run(Thread.java:1583) [?:?]
Stack Trace: org.apache.kafka.connect.errors.DataException: Invalid Java object for schema with type STRING: class java.lang.Long for field: "createdAt"
at org.apache.kafka.connect.data.ConnectSchema.validateValue(ConnectSchema.java:242)
at org.apache.kafka.connect.data.Struct.put(Struct.java:216)
at io.debezium.relational.TableSchemaBuilder.lambda$createValueGenerator$5(TableSchemaBuilder.java:298)
at io.debezium.relational.TableSchema.valueFromColumnData(TableSchema.java:141)
at io.debezium.relational.RelationalChangeRecordEmitter.emitDeleteRecord(RelationalChangeRecordEmitter.java:136)
at io.debezium.relational.RelationalChangeRecordEmitter.emitChangeRecords(RelationalChangeRecordEmitter.java:56)
at io.debezium.connector.postgresql.PostgresChangeRecordEmitter.emitChangeRecords(PostgresChangeRecordEmitter.java:94)
at io.debezium.pipeline.EventDispatcher.dispatchDataChangeEvent(EventDispatcher.java:271)
at io.debezium.connector.postgresql.PostgresStreamingChangeEventSource.processReplicationMessages(PostgresStreamingChangeEventSource.java:315)
at io.debezium.connector.postgresql.PostgresStreamingChangeEventSource.lambda$processMessages$0(PostgresStreamingChangeEventSource.java:217)
at io.debezium.connector.postgresql.connection.pgoutput.PgOutputMessageDecoder.decodeDelete(PgOutputMessageDecoder.java:512)
at io.debezium.connector.postgresql.connection.pgoutput.PgOutputMessageDecoder.processNotEmptyMessage(PgOutputMessageDecoder.java:214)
at io.debezium.connector.postgresql.connection.AbstractMessageDecoder.processMessage(AbstractMessageDecoder.java:41)
at io.debezium.connector.postgresql.connection.PostgresReplicationConnection$1.deserializeMessages(PostgresReplicationConnection.java:642)
at io.debezium.connector.postgresql.connection.PostgresReplicationConnection$1.readPending(PostgresReplicationConnection.java:634)
at io.debezium.connector.postgresql.PostgresStreamingChangeEventSource.processMessages(PostgresStreamingChangeEventSource.java:217)
at io.debezium.connector.postgresql.PostgresStreamingChangeEventSource.execute(PostgresStreamingChangeEventSource.java:179)
at io.debezium.connector.postgresql.PostgresStreamingChangeEventSource.execute(PostgresStreamingChangeEventSource.java:42)
at io.debezium.pipeline.ChangeEventSourceCoordinator.streamEvents(ChangeEventSourceCoordinator.java:280)
at io.debezium.pipeline.ChangeEventSourceCoordinator.executeChangeEventSources(ChangeEventSourceCoordinator.java:197)
at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:140)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
at java.base/java.lang.Thread.run(Thread.java:1583)
```
### Contribute
- [ ] Yes, I want to contribute
---
**Internal Tracking:** https://github.com/airbytehq/oncall/issues/10972
Hướng dẫn đóng góp
Đánh giá
Issue này chưa được đánh giá.