airbytehq / airbytehq/airbyte

[destination-clickhouse] Replication MySQL (CDC) -> ClickHouse fails: "An attempt to write null into not nullable column '_ab_cdc_cursor'

Offen
#69,333 3 Kommentare 6 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
area/connectors autoteam community connectors/destination/clickhouse needs-triage team/extensibility type/bug
Vorherrschende Sprache
Python
Sterne
22.1k
Forks
5.3k
PR-Merge-Kennzahlen
PR-Kennzahlen ausstehend

Beschreibung

### Connector Name

destination-clickhouse

### Connector Version

2.1.13

### What step the error happened?

During the sync

### Relevant information

Hello,

We are experiencing a persistent replication failure when syncing data from a MySQL source to a ClickHouse destination using CDC with the sync mode `incremental | append - deduped`.

The synchronization fails systematically with the following error message from the destination:
`java.lang.IllegalArgumentException: An attempt to write null into not nullable column '_ab_cdc_cursor'`

We tried :
- Downgrade both connectors version, that's working for an older version of the Clickhouse's connector. For the MySQL connector, nothing change regardless the version. Only the downgrade of Clickhouse has worked.
- We tried on both Airbyte 1.8 and Airbyte 2.0, nothing change.
- Sync only one database, produce the same error.

We also run a separate synchronization from the exact same MySQL source to a PostgreSQL destination (also using CDC), and that synchronization works perfectly without any errors.

[Airbyte-log.txt](https://github.com/user-attachments/files/23547951/Airbyte-log.txt)

### Relevant log output

```shell

```

### Contribute

- [ ] Yes, I want to contribute

Beitragsleitfaden

Beitragsleitfaden öffnen

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.