airbytehq / airbytehq/airbyte

[Source MSSQL]: "Could not find existing redo log information while attempting schema only recovery snapshot" issue in connector version 4.3.2 and 4.3.3

Aperta
#73,326 7 commenti 2 reazioni 1 assegnatario Rivendicata da @yardencarmeli Vedi su GitHub
area/connectors autoteam community connectors/source/mssql hyd-prove hyd-review needs-triage team/extensibility type/bug
Lingua principale
Python
Stelle
22.1k
Fork
5.3k
Metriche di merge delle PR
Metriche PR in attesa

Descrizione

### Connector Name

source-mssql

### Connector Version

4.3.3

### What step the error happened?

During the sync

### Relevant information

I am encountering a persistent Could not find existing redo log information while attempting schema only recovery snapshot error with the MSSQL Source connector version 4.3.2 and 4.3.3

This error persists despite:
1. Resetting the connection data.
2. Creating a completely NEW Source entry.
3. Verifying MSSQL CDC logs are present and retention is sufficient.
4. Even tried installing new airbyte instance and syncing from another db
5. The airbyte user has full access to db, admin user
6. Snapshot Isolation: Verified ALLOW_SNAPSHOT_ISOLATION is ON.

There is a workaround I found but that cause some data misses. ( I run a full load on connector version 4.2.6 once then upgrade the connector and start using incremental load, then it works)

**Log output**:
[cmsconncetdb___cmsconncetdb_logs_5_txt.txt](https://github.com/user-attachments/files/25286261/cmsconncetdb___cmsconncetdb_logs_5_txt.txt)

### Relevant log output

```shell
table.include.list = $^

2026-02-13 14:15:40 info INFO pool-3-thread-1 i.d.c.CommonConnectorConfig(getSourceInfoStructMaker):2070 Loading the custom source info struct maker plugin: io.debezium.connector.sqlserver.SqlServerSourceInfoStructMaker
2026-02-13 14:15:40 info INFO pool-3-thread-1 i.d.c.CommonConnectorConfig(getTopicNamingStrategy):1767 Loading the custom topic naming strategy plugin: io.debezium.schema.SchemaTopicNamingStrategy
2026-02-13 14:15:41 info INFO pool-3-thread-1 i.d.c.c.BaseSourceTask(getPreviousOffsets):584 No previous offsets found
2026-02-13 14:15:41 info INFO pool-3-thread-1 i.d.c.s.SqlServerConnectorTask(start):121 Guardrail validation skipped
2026-02-13 14:15:41 error ERROR debezium-engine i.d.e.a.AsyncEmbeddedEngine(startSourceTasks):496 1 task(s) out of 1 failed to start.
2026-02-13 14:15:41 error ERROR debezium-engine i.d.e.a.AsyncEmbeddedEngine(closeEngineWithException):325 Engine has failed with java.util.concurrent.ExecutionException: io.debezium.DebeziumException: Could not find existing redo log information while attempting schema only recovery snapshot
at java.base/java.util.concurrent.FutureTask.report(FutureTask.java:122) ~[?:?]
at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:191) ~[?:?]
at io.debezium.embedded.async.AsyncEmbeddedEngine.startSourceTasks(AsyncEmbeddedEngine.java:471) ~[debezium-embedded-3.3.0.Final.jar:3.3.0.Final]
at io.debezium.embedded.async.AsyncEmbeddedEngine.run(AsyncEmbeddedEngine.java:218) ~[debezium-embedded-3.3.0.Final.jar:3.3.0.Final]
at java.base/java.lang.Thread.run(Thread.java:1583) [?:?]
Caused by: io.debezium.DebeziumException: Could not find existing redo log information while attempting schema only recovery snapshot
at io.debezium.connector.common.BaseSourceTask.validateSchemaHistory(BaseSourceTask.java:95) ~[debezium-core-3.3.0.Final.jar:3.3.0.Final]
at io.debezium.connector.sqlserver.SqlServerConnectorTask.start(SqlServerConnectorTask.java:127) ~[debezium-connector-sqlserver-3.3.0.Final.jar:3.3.0.Final]
at io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:261) ~[debezium-core-3.3.0.Final.jar:3.3.0.Final]
at io.debezium.embedded.async.AsyncEmbeddedEngine.lambda$startSourceTasks$2(AsyncEmbeddedEngine.java:450) ~[debezium-embedded-3.3.0.Final.jar:3.3.0.Final]
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317) ~[?:?]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572) ~[?:?]
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317) ~[?:?]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
... 1 more

Stack Trace: java.util.concurrent.ExecutionException: io.debezium.DebeziumException: Could not find existing redo log information while attempting schema only recovery snapshot
at java.base/java.util.concurrent.FutureTask.report(FutureTask.java:122)
at java.base/java.util.concurrent.FutureTask.get(FutureTask.java:191)
at io.debezium.embedded.async.AsyncEmbeddedEngine.startSourceTasks(AsyncEmbeddedEngine.java:471)
at io.debezium.embedded.async.AsyncEmbeddedEngine.run(AsyncEmbeddedEngine.java:218)
at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: io.debezium.DebeziumException: Could not find existing redo log information while attempting schema only recovery snapshot
at io.debezium.connector.common.BaseSourceTask.validateSchemaHistory(BaseSourceTask.java:95)
at io.debezium.connector.sqlserver.SqlServerConnectorTask.start(SqlServerConnectorTask.java:127)
at io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:261)
at io.debezium.embedded.async.AsyncEmbeddedEngine.lambda$startSourceTasks$2(AsyncEmbeddedEngine.java:450)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
... 1 more

2026-02-13 14:15:41 info INFO debezium-engine i.d.e.a.AsyncEmbeddedEngine(setEngineState):783 Engine state has changed from 'STARTING_TASKS' to 'STOPPING'
2026-02-13 14:15:41 info INFO pool-3-thread-1 i.d.c.c.BaseSourceTask(stop):477 Stopping down connector
2026-02-13 14:15:41 info INFO debezium-engine i.d.e.a.AsyncEmbeddedEngine(stopSourceTasks):680 Stopped task #1 out of 1 tasks (it took 1 ms to stop the task).
2026-02-13 14:15:41 info INFO debezium-engine i.a.c.r.c.CdcPartitionReader$ConnectorCallback(taskStopped):510 Debezium Task stopped
2026-02-13 14:15:41 info INFO debezium-engine o.a.k.c.s.FileOffsetBackingStore(stop):72 Stopped FileOffsetBackingStore
2026-02-13 14:15:41 info INFO debezium-engine i.a.c.r.c.CdcPartitionReader$ConnectorCallback(connectorStopped):502 Debezium connector stopped
2026-02-13 14:15:41 info INFO debezium-engine i.d.e.a.AsyncEmbeddedEngine(finishShutDown):353 Engine is stopped.
2026-02-13 14:15:41 info INFO debezium-engine i.d.e.a.AsyncEmbeddedEngine(setEngineState):783 Engine state has changed from 'STOPPING' to 'STOPPED'
2026-02-13 14:15:41 warn WARN debezium-engine i.a.c.r.c.CdcPartitionReader$CompletionCallback(handle):490 Debezium engine has NOT shut down successfully: io.debezium.DebeziumException: Could not find existing redo log information while attempting schema only recovery snapshot io.debezium.DebeziumException: Could not find existing redo log information while attempting schema only recovery snapshot
at io.debezium.connector.common.BaseSourceTask.validateSchemaHistory(BaseSourceTask.java:95) ~[debezium-core-3.3.0.Final.jar:3.3.0.Final]
at io.debezium.connector.sqlserver.SqlServerConnectorTask.start(SqlServerConnectorTask.java:127) ~[debezium-connector-sqlserver-3.3.0.Final.jar:3.3.0.Final]
at io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:261) ~[debezium-core-3.3.0.Final.jar:3.3.0.Final]
at io.debezium.embedded.async.AsyncEmbeddedEngine.lambda$startSourceTasks$2(AsyncEmbeddedEngine.java:450) ~[debezium-embedded-3.3.0.Final.jar:3.3.0.Final]
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317) ~[?:?]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572) ~[?:?]
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317) ~[?:?]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
at java.base/java.lang.Thread.run(Thread.java:1583) [?:?]

Stack Trace: io.debezium.DebeziumException: Could not find existing redo log information while attempting schema only recovery snapshot
at io.debezium.connector.common.BaseSourceTask.validateSchemaHistory(BaseSourceTask.java:95)
at io.debezium.connector.sqlserver.SqlServerConnectorTask.start(SqlServerConnectorTask.java:127)
at io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:261)
at io.debezium.embedded.async.AsyncEmbeddedEngine.lambda$startSourceTasks$2(AsyncEmbeddedEngine.java:450)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
at java.base/java.lang.Thread.run(Thread.java:1583)

2026-02-13 14:15:41 info INFO DefaultDispatcher-worker-4#global-round-1-partition-1-read i.a.c.r.c.CdcPartitionReader(run):209 Debezium Engine has shut down and relinquished control, summary: {debezium-version=3.3.0.Final, records-emitted=0, records-discarded=0, heartbeats=0, tombstones=0, events=0, events-without-source-record=0, source-records-without-position=0, event-values-without-position=0, exception=class io.debezium.DebeziumException}.
2026-02-13 14:15:41 info INFO DefaultDispatcher-worker-4#global-round-1-partition-1-read i.a.c.r.FeedReader(readPartitionWithResources):251 releasing resources acquired to read partition 1 for 'global' in round 1
2026-02-13 14:15:41 info INFO DefaultDispatcher-worker-4#global-round-1-partition-1-read o.a.k.c.s.FileOffsetBackingStore(stop):72 Stopped FileOffsetBackingStore
2026-02-13 14:15:41 warn WARN DefaultDispatcher-worker-4#global i.a.c.r.FeedReader(awaitAllPartitionReaders):294 exception thrown in partition 1 / 1 for 'global' io.debezium.DebeziumException: Could not find existing redo log information while attempting schema only recovery snapshot
at io.debezium.connector.common.BaseSourceTask.validateSchemaHistory(BaseSourceTask.java:95) ~[debezium-core-3.3.0.Final.jar:3.3.0.Final]
at io.debezium.connector.sqlserver.SqlServerConnectorTask.start(SqlServerConnectorTask.java:127) ~[debezium-connector-sqlserver-3.3.0.Final.jar:3.3.0.Final]
at io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:261) ~[debezium-core-3.3.0.Final.jar:3.3.0.Final]
at io.debezium.embedded.async.AsyncEmbeddedEngine.lambda$startSourceTasks$2(AsyncEmbeddedEngine.java:450) ~[debezium-embedded-3.3.0.Final.jar:3.3.0.Final]
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317) ~[?:?]
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572) ~[?:?]
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317) ~[?:?]
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
at java.base/java.lang.Thread.run(Thread.java:1583) ~[?:?]

Stack Trace: io.debezium.DebeziumException: Could not find existing redo log information while attempting schema only recovery snapshot
at io.debezium.connector.common.BaseSourceTask.validateSchemaHistory(BaseSourceTask.java:95)
at io.debezium.connector.sqlserver.SqlServerConnectorTask.start(SqlServerConnectorTask.java:127)
at io.debezium.connector.common.BaseSourceTask.start(BaseSourceTask.java:261)
at io.debezium.embedded.async.AsyncEmbeddedEngine.lambda$startSourceTasks$2(AsyncEmbeddedEngine.java:450)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:572)
at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:317)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
at java.base/java.lang.Thread.run(Thread.java:1583)
```

### Contribute

- [x] Yes, I want to contribute

---
**Internal Tracking:** https://github.com/airbytehq/oncall/issues/11277

Guida per i contributori

Apri la guida per i contributori

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.