S3 Datalake Connector: Failures marked as success. Main branch never created.
- Vorherrschende Sprache
- Python
- Sterne
- 22.1k
- Forks
- 5.3k
- PR-Merge-Kennzahlen
- PR-Kennzahlen ausstehend
Beschreibung
### Connector Name
s3-data-lake
### Connector Version
0.3.40
### What step the error happened?
During the sync
### Relevant information
When syncing data to S3 from MSSQL. When Sync fails, the connector incorrectly reports success and leaves data only in the airbyte_staging branch, never actually creating the main branch. Subsequent syncs shows success, but never materialize main branch meaning data is inaccessible unless a tag/branch/version is specified. Doesn't look like the retry/recovery mechanism is properly resuming and completing all required tasks.
### Relevant log output
```shell
2026-01-20 15:50:43 info Records read: 80905000 (108 GB)
2026-01-20 15:50:43 info INFO main i.a.c.i.s.r.s.SourceStateIterator(computeNext):50 sending state message, with count per stream: {Erp_LaborPart=10000}
2026-01-20 15:51:09 info INFO DefaultDispatcher-worker-2 i.a.i.d.s.S3DataLakeDirectLoader(finish):104 Finishing writing to airbyte_staging
2026-01-20 15:51:09 info INFO DefaultDispatcher-worker-4 i.a.i.d.s.S3DataLakeDirectLoader(finish):104 Finishing writing to airbyte_staging
2026-01-20 15:51:09 error DestinationWriter error:
2026-01-20 15:51:09 error DestinationWriter error:
2026-01-20 15:51:09 warn Attempted to close a destination which is already closed.
2026-01-20 15:51:09 info DestinationWriter finished.
2026-01-20 15:51:09 info MessageProcessor finished.
2026-01-20 15:51:09 error DestinationReader error:
2026-01-20 15:51:09 error SourceReader error:
2026-01-20 15:51:09 info DestinationReader finished.
2026-01-20 15:51:09 info SourceReader finished.
2026-01-20 15:51:09 error runJobs failed; recording failure but continuing to finish.
2026-01-20 15:51:09 info Closing StateCheckSumCountEventHandler
2026-01-20 15:51:09 info Sync summary: {
"status" : "failed",
"recordsSynced" : 78873258,
"bytesSynced" : 116102504293,
"startTime" : 1768938126029,
"endTime" : 1768949469461,
"totalStats" : {
"bytesCommitted" : 116102504293,
"bytesEmitted" : 117006424403,
"destinationStateMessagesEmitted" : 1172292,
"destinationWriteEndTime" : 0,
"destinationWriteStartTime" : 1768938126310,
"meanSecondsBeforeSourceStateMessageEmitted" : 297,
"maxSecondsBeforeSourceStateMessageEmitted" : 8220,
"maxSecondsBetweenStateMessageEmittedandCommitted" : 483,
"meanSecondsBetweenStateMessageEmittedandCommitted" : 145,
"recordsEmitted" : 80899907,
"recordsCommitted" : 78873258,
"recordsFilteredOut" : 0,
"bytesFilteredOut" : 0,
"replicationEndTime" : 1768949469457,
"replicationStartTime" : 1768938126029,
"sourceReadEndTime" : 0,
"sourceReadStartTime" : 1768938126310,
"sourceStateMessagesEmitted" : 1215744
},
"streamStats" : [ various_streams.... ],
"performanceMetrics" : { }
}
2026-01-20 15:51:09 info Failures: [ {
"failureOrigin" : "replication",
"internalMessage" : "Broken pipe",
"externalMessage" : "Something went wrong during replication",
"metadata" : {
"attemptNumber" : 0,
"jobId" : 1031
},
"stacktrace" : "java.io.IOException: Broken pipe\n\tat java.base/sun.nio.ch.UnixFileDispatcherImpl.write0(Native Method)\n\tat java.base/sun.nio.ch.UnixFileDispatcherImpl.write(UnixFileDispatcherImpl.java:65)\n\tat java.base/sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:137)\n\tat java.base/sun.nio.ch.IOUtil.write(IOUtil.java:102)\n\tat java.base/sun.nio.ch.IOUtil.write(IOUtil.java:72)\n\tat java.base/sun.nio.ch.FileChannelImpl.write(FileChannelImpl.java:300)\n\tat java.base/sun.nio.ch.ChannelOutputStream.writeFully(ChannelOutputStream.java:68)\n\tat java.base/sun.nio.ch.ChannelOutputStream.write(ChannelOutputStream.java:105)\n\tat java.base/sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:309)\n\tat java.base/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:381)\n\tat java.base/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:357)\n\tat java.base/sun.nio.cs.StreamEncoder.lockedWrite(StreamEncoder.java:158)\n\tat java.base/sun.nio.cs.StreamEncoder.write(StreamEncoder.java:139)\n\tat java.base/java.io.OutputStreamWriter.write(OutputStreamWriter.java:219)\n\tat java.base/java.io.BufferedWriter.implFlushBuffer(BufferedWriter.java:178)\n\tat java.base/java.io.BufferedWriter.flushBuffer(BufferedWriter.java:163)\n\tat java.base/java.io.BufferedWriter.implWrite(BufferedWriter.java:334)\n\tat java.base/java.io.BufferedWriter.write(BufferedWriter.java:313)\n\tat java.base/java.io.Writer.write(Writer.java:278)\n\tat io.airbyte.container.orchestrator.worker.io.AirbyteMessageBufferedWriter.write(AirbyteMessageBufferedWriter.kt:29)\n\tat io.airbyte.container.orchestrator.worker.io.LocalContainerAirbyteDestination.acceptWithNoTimeoutMonitor(LocalContainerAirbyteDestination.kt:133)\n\tat io.airbyte.container.orchestrator.worker.io.LocalContainerAirbyteDestination.accept(LocalContainerAirbyteDestination.kt:92)\n\tat io.airbyte.container.orchestrator.worker.DestinationWriter.run(ReplicationTask.kt:97)\n\tat io.airbyte.container.orchestrator.worker.DestinationWriter$run$1.invokeSuspend(ReplicationTask.kt)\n\tat kotlin.coroutines.jvm.internal.BaseContinuationImpl.resumeWith(ContinuationImpl.kt:33)\n\tat kotlinx.coroutines.DispatchedTask.run(DispatchedTask.kt:100)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1583)\n",
"timestamp" : 1768949469450
} ]
2026-01-20 15:51:09 info Closing io.micronaut.context.propagation.instrument.execution.ContextPropagatingExecutorService@77e912f8
2026-01-20 15:51:09 info
2026-01-20 15:51:09 info Closing io.micronaut.context.propagation.instrument.execution.ContextPropagatingExecutorService@5248d9cb
2026-01-20 15:51:09 info Closing io.airbyte.container.orchestrator.worker.io.LocalContainerAirbyteDestination@365d1cbf
2026-01-20 15:51:09 info ----- END REPLICATION -----
2026-01-20 15:51:09 info
2026-01-20 15:52:09 warn Failed to wait for exit value file /dest/exitCode.txt to be found.
2026-01-20 15:52:09 error Error closing resource io.airbyte.container.orchestrator.worker.io.LocalContainerAirbyteDestination@365d1cbf; recording failure but continuing.
2026-01-20 15:52:09 info Closing io.airbyte.container.orchestrator.worker.io.LocalContainerAirbyteSource@6014b386
2026-01-20 15:53:09 warn Failed to wait for exit value file /source/exitCode.txt to be found.
2026-01-20 15:53:09 error Error closing resource io.airbyte.container.orchestrator.worker.io.LocalContainerAirbyteSource@6014b386; recording failure but continuing.
2026-01-20 15:53:09 info Closing io.airbyte.container.orchestrator.worker.RecordSchemaValidator@15682f4a
2026-01-20 15:53:09 info Closing io.airbyte.container.orchestrator.persistence.SyncPersistenceImpl@50a526e2
2026-01-20 15:53:10 info Returning output...
2026-01-20 15:53:11 info
----- START POST REPLICATION OPERATIONS -----
2026-01-20 15:53:11 info No post-replication operation(s) to perform.
2026-01-20 15:53:11 info
----- END POST REPLICATION OPERATIONS -----
2026-01-20 15:53:12 info Retry State: RetryManager(completeFailureBackoffPolicy=BackoffPolicy(minInterval=PT10S, maxInterval=PT30M, base=3), partialFailureBackoffPolicy=null, successiveCompleteFailureLimit=5, successivePartialFailureLimit=1000, totalCompleteFailureLimit=10, totalPartialFailureLimit=20, successiveCompleteFailures=0, successivePartialFailures=1, totalCompleteFailures=0, totalPartialFailures=1)
Backoff before next attempt: 0 seconds
>> ATTEMPT 2/2
2026-01-20 15:53:13 info Retry State: RetryManager(completeFailureBackoffPolicy=BackoffPolicy(minInterval=PT10S, maxInterval=PT30M, base=3), partialFailureBackoffPolicy=null, successiveCompleteFailureLimit=5, successivePartialFailureLimit=1000, totalCompleteFailureLimit=10, totalPartialFailureLimit=20, successiveCompleteFailures=0, successivePartialFailures=1, totalCompleteFailures=0, totalPartialFailures=1)
2026-01-20 15:53:14 warn Backing off for: 0 seconds.
2026-01-20 15:53:17 info APPLY Stage: BUILD — (workloadId=c3719fe9-439e-4418-b0e5-9b1a59c65485_1031_1_check)
2026-01-20 15:53:17 info APPLY Stage: CLAIM — (workloadId=c3719fe9-439e-4418-b0e5-9b1a59c65485_1031_1_check)
2026-01-20 15:53:17 info Claimed: true for workload c3719fe9-439e-4418-b0e5-9b1a59c65485_1031_1_check via API in dataplane a01bbbf4-4c67-48bb-a272-cbcc479f74dc (bb060799-545f-4761-99b4-2c30f017afe2)
2026-01-20 15:53:17 info APPLY Stage: LOAD_SHED — (workloadId=c3719fe9-439e-4418-b0e5-9b1a59c65485_1031_1_check)
2026-01-20 15:53:17 info APPLY Stage: CHECK_STATUS — (workloadId=c3719fe9-439e-4418-b0e5-9b1a59c65485_1031_1_check)
2026-01-20 15:53:17 info No pod found running for workload c3719fe9-439e-4418-b0e5-9b1a59c65485_1031_1_check
2026-01-20 15:53:17 info APPLY Stage: MUTEX — (workloadId=c3719fe9-439e-4418-b0e5-9b1a59c65485_1031_1_check)
2026-01-20 15:53:17 info No mutex key specified for workload: c3719fe9-439e-4418-b0e5-9b1a59c65485_1031_1_check. Continuing...
2026-01-20 15:53:17 info APPLY Stage: ARCHITECTURE — (workloadId=c3719fe9-439e-4418-b0e5-9b1a59c65485_1031_1_check)
2026-01-20 15:53:17 info APPLY Stage: LAUNCH — (workloadId=c3719fe9-439e-4418-b0e5-9b1a59c65485_1031_1_check)
2026-01-20 15:53:17 info [initContainer] image: airbyte/workload-init-container:2.0.1 resources: ResourceRequirements(claims=[], limits={}, requests={}, additionalProperties={})
2026-01-20 15:53:25 info Attempting to update workload: c3719fe9-439e-4418-b0e5-9b1a59c65485_1031_1_check to LAUNCHED.
2026-01-20 15:53:25 info Pipeline completed for workload: c3719fe9-439e-4418-b0e5-9b1a59c65485_1031_1_check.
2026-01-20 15:53:29 info
2026-01-20 15:53:29 info Transitioning workload to running state
2026-01-20 15:53:29 info Connector exited, processing output
2026-01-20 15:53:29 info Output file jobOutput.json found
2026-01-20 15:53:29 info ----- START CHECK -----
2026-01-20 15:53:29 info
2026-01-20 15:53:29 info Connector exited with exit code 0
2026-01-20 15:53:29 info Reading messages from protocol version 0.2.0
2026-01-20 15:53:29 info INFO main i.a.i.s.m.MssqlSource(main):635 starting source: class io.airbyte.integrations.source.mssql.MssqlSource
2026-01-20 15:53:29 info INFO main i.a.c.i.b.IntegrationCliParser$Companion(parseOptions):144 integration args: {check=null, config=/config/connectionConfiguration.json}
2026-01-20 15:53:29 info INFO main i.a.c.i.b.IntegrationRunner(runInternal):130 Running integration: io.airbyte.cdk.integrations.base.ssh.SshWrappedSource
2026-01-20 15:53:29 info INFO main i.a.c.i.b.IntegrationRunner(runInternal):131 Command: CHECK
2026-01-20 15:53:29 info INFO main i.a.c.i.b.IntegrationRunner(runInternal):132 Integration config: IntegrationConfig{command=CHECK, configPath='/config/connectionConfiguration.json', catalogPath='null', statePath='null'}
2026-01-20 15:53:29 warn WARN main c.n.s.UnknownKeywordFactory(lambda$getKeyword$0):37 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword or if it should generate annotations AnnotationKeyword
2026-01-20 15:53:29 warn WARN main c.n.s.UnknownKeywordFactory(lambda$getKeyword$0):37 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword or if it should generate annotations AnnotationKeyword
2026-01-20 15:53:29 warn WARN main c.n.s.UnknownKeywordFactory(lambda$getKeyword$0):37 Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword or if it should generate annotations AnnotationKeyword
2026-01-20 15:53:29 warn WARN main c.n.s.UnknownKeywordFactory(lambda$getKeyword$0):37 Unknown keyword display_type - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword or if it should generate annotations AnnotationKeyword
2026-01-20 15:53:29 warn WARN main c.n.s.UnknownKeywordFactory(lambda$getKeyword$0):37 Unknown keyword min - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword or if it should generate annotations AnnotationKeyword
2026-01-20 15:53:29 warn WARN main c.n.s.UnknownKeywordFactory(lambda$getKeyword$0):37 Unknown keyword max - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword or if it should generate annotations AnnotationKeyword
2026-01-20 15:53:29 warn WARN main c.n.s.UnknownKeywordFactory(lambda$getKeyword$0):37 Unknown keyword always_show - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword or if it should generate annotations AnnotationKeyword
2026-01-20 15:53:29 info INFO main i.a.c.i.b.s.SshTunnel$Companion(getInstance):424 Starting connection with method: NO_TUNNEL
2026-01-20 15:53:29 info INFO main c.z.h.HikariDataSource():79 HikariPool-1 - Starting...
2026-01-20 15:53:29 info INFO main c.z.h.HikariDataSource():81 HikariPool-1 - Start completed.
2026-01-20 15:53:29 info INFO main i.a.c.i.s.j.AbstractJdbcSource(getCheckOperations$lambda$6):343 Attempting to get metadata from the database to see if we can connect.
2026-01-20 15:53:29 info INFO main i.a.i.s.m.MssqlSource(lambda$assertCdcEnabledInDb$14):332 Checking that cdc is enabled on database 'Epicor10TEST' using the query: 'SELECT name, is_cdc_enabled FROM sys.databases WHERE name = ?'
2026-01-20 15:53:29 info INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows
2026-01-20 15:53:29 info INFO main i.a.i.s.m.MssqlSource(lambda$assertCdcSchemaQueryable$15):364 Checking user 'ETLAdmin' can query the cdc schema and that we have at least 1 cdc enabled table using the query: 'USE [Epicor10TEST]; SELECT * FROM cdc.change_tables'
2026-01-20 15:53:29 info INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows
2026-01-20 15:53:29 info INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(accept):33 Set new fetch size: 330990 rows
2026-01-20 15:53:29 info INFO main i.a.c.d.j.s.TwoStageSizeEstimator$Companion(getTargetBufferByteSize):80 Max memory limit: 12582912000, JDBC buffer size: 7549747200
2026-01-20 15:53:29 info INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows
2026-01-20 15:53:29 info INFO main i.a.i.s.m.MssqlSource(lambda$assertSqlServerAgentRunning$16):392 Checking that the SQL Server Agent is running using the query: 'SELECT status_desc FROM sys.dm_server_services WHERE [servicename] LIKE 'SQL Server Agent%' OR [servicename] LIKE 'SQL Server 代理%' '
2026-01-20 15:53:29 info INFO main i.a.c.d.j.s.AdaptiveStreamingQueryConfig(initialize):24 Set initial fetch size: 10 rows
2026-01-20 15:53:29 info INFO main c.z.h.HikariDataSource(close):349 HikariPool-1 - Shutdown initiated...
2026-01-20 15:53:29 info INFO main c.z.h.HikariDataSource(close):351 HikariPool-1 - Shutdown completed.
2026-01-20 15:53:29 info INFO main i.a.c.i.b.IntegrationRunner(runInternal):224 Completed integration: io.airbyte.cdk.integrations.base.ssh.SshWrappedSource
2026-01-20 15:53:29 info INFO main i.a.i.s.m.MssqlSource(main):637 completed source: class io.airbyte.integrations.source.mssql.MssqlSource
2026-01-20 15:53:29 info Checking for optional control message...
2026-01-20 15:53:29 info Writing output of c3719fe9-439e-4418-b0e5-9b1a59c65485_1031_1_check to the doc store
2026-01-20 15:53:29 info Workload successfully transitioned to running state
2026-01-20 15:53:29 info Marking workload c3719fe9-439e-4418-b0e5-9b1a59c65485_1031_1_check as successful
2026-01-20 15:53:29 info Deliberately exiting process with code 0.
2026-01-20 15:53:29 info
2026-01-20 15:53:29 info ----- END CHECK -----
2026-01-20 15:53:29 info
2026-01-20 15:53:30 info APPLY Stage: BUILD — (workloadId=2aa8dd19-cecf-4fa9-8d59-e01e742f21f7_1031_1_check)
2026-01-20 15:53:30 info APPLY Stage: CLAIM — (workloadId=2aa8dd19-cecf-4fa9-8d59-e01e742f21f7_1031_1_check)
2026-01-20 15:53:30 info Claimed: true for workload 2aa8dd19-cecf-4fa9-8d59-e01e742f21f7_1031_1_check via API in dataplane a01bbbf4-4c67-48bb-a272-cbcc479f74dc (bb060799-545f-4761-99b4-2c30f017afe2)
2026-01-20 15:53:30 info APPLY Stage: LOAD_SHED — (workloadId=2aa8dd19-cecf-4fa9-8d59-e01e742f21f7_1031_1_check)
2026-01-20 15:53:30 info APPLY Stage: CHECK_STATUS — (workloadId=2aa8dd19-cecf-4fa9-8d59-e01e742f21f7_1031_1_check)
2026-01-20 15:53:30 info No pod found running for workload 2aa8dd19-cecf-4fa9-8d59-e01e742f21f7_1031_1_check
2026-01-20 15:53:30 info APPLY Stage: MUTEX — (workloadId=2aa8dd19-cecf-4fa9-8d59-e01e742f21f7_1031_1_check)
2026-01-20 15:53:30 info No mutex key specified for workload: 2aa8dd19-cecf-4fa9-8d59-e01e742f21f7_1031_1_check. Continuing...
2026-01-20 15:53:30 info APPLY Stage: ARCHITECTURE — (workloadId=2aa8dd19-cecf-4fa9-8d59-e01e742f21f7_1031_1_check)
2026-01-20 15:53:30 info APPLY Stage: LAUNCH — (workloadId=2aa8dd19-cecf-4fa9-8d59-e01e742f21f7_1031_1_check)
2026-01-20 15:53:30 info [initContainer] image: airbyte/workload-init-container:2.0.1 resources: ResourceRequirements(claims=[], limits={}, requests={}, additionalProperties={})
2026-01-20 15:53:37 info Attempting to update workload: 2aa8dd19-cecf-4fa9-8d59-e01e742f21f7_1031_1_check to LAUNCHED.
2026-01-20 15:53:37 info Pipeline completed for workload: 2aa8dd19-cecf-4fa9-8d59-e01e742f21f7_1031_1_check.
2026-01-20 15:53:41 info
2026-01-20 15:53:41 info Transitioning workload to running state
2026-01-20 15:53:41 info ----- START CHECK -----
2026-01-20 15:53:41 info
2026-01-20 15:53:41 info Workload successfully transitioned to running state
2026-01-20 15:53:43 info Connector exited, processing output
2026-01-20 15:53:43 info Output file jobOutput.json found
2026-01-20 15:53:43 info Connector exited with exit code 0
2026-01-20 15:53:43 info Reading messages from protocol version 0.2.0
2026-01-20 15:53:43 info INFO main i.m.c.e.DefaultEnvironment():168 Established active environments: [k8s, cloud, cli, destination, aws, connector]
2026-01-20 15:53:43 info INFO main i.a.c.AirbyteConnectorRunnable(run):35 Executing class io.airbyte.cdk.load.check.CheckOperation operation.
2026-01-20 15:53:43 warn WARN main o.a.i.r.RESTSessionCatalog(initialize):230 Iceberg REST client is missing the OAuth2 server URI configuration and defaults to http://10.30.3.84:8181/api/catalogv1/oauth/tokens. This automatic fallback will be removed in a future Iceberg release.It is recommended to configure the OAuth2 endpoint using the 'oauth2-server-uri' property to be prepared. This warning will disappear if the OAuth2 endpoint is explicitly configured. See https://github.com/apache/iceberg/issues/10537
2026-01-20 15:53:43 info INFO main o.a.i.CatalogUtil(loadFileIO):346 Loading custom FileIO implementation: org.apache.iceberg.aws.s3.S3FileIO
2026-01-20 15:53:43 info INFO main i.a.c.l.t.i.p.i.IcebergUtil(createTable):138 Creating Iceberg table 'raw.airbyte_test_table_3e2f1e72_cdf4_413d_952e_4739e84db907'....
2026-01-20 15:53:43 info INFO main o.a.i.CatalogUtil(loadFileIO):346 Loading custom FileIO implementation: org.apache.iceberg.aws.s3.S3FileIO
2026-01-20 15:53:43 info INFO main i.a.c.AirbyteConnectorRunnable(run):47 Flushing output consumer prior to shutdown.
2026-01-20 15:53:43 info INFO main i.a.c.AirbyteConnectorRunnable(run):49 Completed integration: airbyte/destination-s3-data-lake.
2026-01-20 15:53:43 info Checking for optional control message...
2026-01-20 15:53:43 info Writing output of 2aa8dd19-cecf-4fa9-8d59-e01e742f21f7_1031_1_check to the doc store
2026-01-20 15:53:43 info Marking workload 2aa8dd19-cecf-4fa9-8d59-e01e742f21f7_1031_1_check as successful
2026-01-20 15:53:43 info
2026-01-20 15:53:43 info Deliberately exiting process with code 0.
2026-01-20 15:53:43 info ----- END CHECK -----
2026-01-20 15:53:43 info
2026-01-20 15:53:51 info APPLY Stage: BUILD — (workloadId=a434d886-40a9-4eea-a9b1-ac24647887dd_1031_1_sync)
2026-01-20 15:53:51 info APPLY Stage: CLAIM — (workloadId=a434d886-40a9-4eea-a9b1-ac24647887dd_1031_1_sync)
2026-01-20 15:53:51 info Claimed: true for workload a434d886-40a9-4eea-a9b1-ac24647887dd_1031_1_sync via API in dataplane a01bbbf4-4c67-48bb-a272-cbcc479f74dc (bb060799-545f-4761-99b4-2c30f017afe2)
2026-01-20 15:53:51 info APPLY Stage: LOAD_SHED — (workloadId=a434d886-40a9-4eea-a9b1-ac24647887dd_1031_1_sync)
2026-01-20 15:53:51 info APPLY Stage: CHECK_STATUS — (workloadId=a434d886-40a9-4eea-a9b1-ac24647887dd_1031_1_sync)
2026-01-20 15:53:51 info No pod found running for workload a434d886-40a9-4eea-a9b1-ac24647887dd_1031_1_sync
2026-01-20 15:53:51 info APPLY Stage: MUTEX — (workloadId=a434d886-40a9-4eea-a9b1-ac24647887dd_1031_1_sync)
2026-01-20 15:53:51 info Mutex key: a434d886-40a9-4eea-a9b1-ac24647887dd specified for workload: a434d886-40a9-4eea-a9b1-ac24647887dd_1031_1_sync. Attempting to delete existing pods...
2026-01-20 15:53:51 info Existing pods for mutex key: a434d886-40a9-4eea-a9b1-ac24647887dd deleted.
2026-01-20 15:53:51 info APPLY Stage: ARCHITECTURE — (workloadId=a434d886-40a9-4eea-a9b1-ac24647887dd_1031_1_sync)
2026-01-20 15:53:51 info APPLY Stage: LAUNCH — (workloadId=a434d886-40a9-4eea-a9b1-ac24647887dd_1031_1_sync)
2026-01-20 15:53:51 info [initContainer] image: airbyte/workload-init-container:2.0.1 resources: ResourceRequirements(claims=[], limits={memory=2Gi, cpu=2}, requests={memory=2Gi, cpu=2}, additionalProperties={})
2026-01-20 15:53:51 info Launching replication pod: replication-job-1031-attempt-1 (selectors = {}) with containers:
2026-01-20 15:53:51 info [source] image: airbyte/source-mssql:4.2.6 resources: ResourceRequirements(claims=[], limits={memory=2Gi, cpu=2}, requests={memory=1Gi, cpu=1}, additionalProperties={})
2026-01-20 15:53:51 info [destination] image: airbyte/destination-s3-data-lake:0.3.40 resources: ResourceRequirements(claims=[], limits={memory=2Gi, cpu=2}, requests={memory=1Gi, cpu=1}, additionalProperties={})
2026-01-20 15:53:51 info [orchestrator] image: airbyte/container-orchestrator:2.0.1 resources: ResourceRequirements(claims=[], limits={memory=2Gi, cpu=2}, requests={memory=2Gi, cpu=2}, additionalProperties={})
2026-01-20 16:24:50 info
----- START POST REPLICATION OPERATIONS -----
2026-01-20 16:24:50 info No post-replication operation(s) to perform.
2026-01-20 16:24:50 info
----- END POST REPLICATION OPERATIONS -----
2026-01-20 17:24:01 error Stage Pipeline Exception: io.airbyte.workload.launcher.pipeline.stages.model.StageError: io.airbyte.workers.exception.ResourceConstraintException: Unable to start the REPLICATION pod. This may be due to insufficient system resources. Please check available resources and try again.
message: io.airbyte.workers.exception.ResourceConstraintException: Unable to start the REPLICATION pod. This may be due to insufficient system resources. Please check available resources and try again.
stackTrace: [Ljava.lang.StackTraceElement;@6c5e5e26
2026-01-20 17:24:01 info Attempting to update workload: a434d886-40a9-4eea-a9b1-ac24647887dd_1031_1_sync to FAILED.
2026-01-20 17:24:01 info Pipeline aborted after error for workload: a434d886-40a9-4eea-a9b1-ac24647887dd_1031_1_sync.
```
### Contribute
- [ ] Yes, I want to contribute
---
**Internal Tracking:** https://github.com/airbytehq/oncall/issues/10984
Beitragsleitfaden
Bewertung
Dieses Issue wurde noch nicht bewertet.