airbytehq / airbytehq/airbyte

[source-github] Destination Process Exits with Code 143 After Upgrading to Latest Experimental Airbyte Version

Đang mở
#80,168 3 bình luận 0 reaction 0 người được giao Xem trên GitHub
area/connectors autoteam community connectors/source/github needs-triage team/use type/bug
Ngôn ngữ chính
Python
Star
22.1k
Fork
5.3k
Chỉ số merge pull request
Chỉ số pull request đang chờ

Mô tả

### Connector Name

source-github

### Connector Version

2.1.30

### What step the error happened?

During the sync

### Relevant information

## Description

We are testing the GitHub connector on the latest experimental Airbyte version.

Previously, we observed extremely high memory consumption during large GitHub syncs (approximately 128 GB). While reviewing the recent fixes, we noticed the following change:

> Log event flushing: Fixed an issue where log events could accumulate in memory instead of being flushed, reducing memory overhead.

This issue appeared very similar to what we were experiencing, so we upgraded to the latest experimental version to validate the fix.

## Current Behavior

After upgrading, the previous excessive memory usage is no longer observed. However, the sync now consistently fails with the following error:

```text
2026-06-17 07:21:22,396 [pool-4-thread-4] ERROR i.a.c.o.w.DestinationReader(run):60 - DestinationReader error:

io.airbyte.workers.internal.exception.DestinationException: Destination process exited with non-zero exit code 143

at io.airbyte.container.orchestrator.worker.DestinationReader.run(ReplicationTask.kt:55)

at io.airbyte.container.orchestrator.worker.ReplicationWorker$runJobs$2$tasks$1$1.invokeSuspend(ReplicationWorker.kt:152)

at io.airbyte.container.orchestrator.worker.ReplicationWorker$runJobs$2$tasks$1$1.invoke(ReplicationWorker.kt)

at io.airbyte.container.orchestrator.worker.ReplicationWorker$runJobs$2$tasks$1$1.invoke(ReplicationWorker.kt)

at io.airbyte.container.orchestrator.worker.util.AsyncUtils$runAsync$1$1.invokeSuspend(AsyncUtils.kt:22)

at io.airbyte.container.orchestrator.worker.util.AsyncUtils$runAsync$1$1.invoke(AsyncUtils.kt)

at io.airbyte.container.orchestrator.worker.util.AsyncUtils$runAsync$1$1.invoke(AsyncUtils.kt)

at kotlinx.coroutines.intrinsics.UndispatchedKt.startUndspatched(Undispatched.kt:66)

at kotlinx.coroutines.intrinsics.UndispatchedKt.startUndispatchedOrReturn(Undispatched.kt:43)

at kotlinx.coroutines.BuildersKt__Builders_commonKt.withContext(Builders.common.kt:165)

at kotlinx.coroutines.BuildersKt.withContext(Unknown Source)
```

## Resource Configuration

We have allocated approximately 32 GB of memory to each container involved in the replication job.

However, when the failure occurs:

* Memory usage remains around 2 GB per container.
* No memory spike is observed.
* No OOMKilled events are reported.
* The destination container exits with code 143.
Supported images
Image

### Relevant log output

```shell

```

### Contribute

- [ ] Yes, I want to contribute

---
**Internal Tracking:** https://github.com/airbytehq/oncall/issues/12896

Hướng dẫn đóng góp

Mở hướng dẫn đóng góp

Đánh giá

Issue này chưa được đánh giá.

Nhận issue mới trong hộp thư của bạn

Bản tóm tắt ngắn những issue GitHub phù hợp với người mới.