airbytehq / airbytehq/airbyte

[source-marketo] Introduce read timeout and window_in_days

Open
#78,478 2 comments 0 reactions 0 assignees View on GitHub
area/connectors autoteam connectors/source/marketo needs-triage team/extensibility type/bug
Dominant language
Python
Stars
22.1k
Forks
5.3k
PR merge metrics
PR metrics pending

Description

### Connector Name

source-marketo

### Connector Version

2.0.1

### What step the error happened?

None

### Relevant information

After running reverse-ETL process outside of Airbyte all records to be updated. The load is then too heavy for the Airbyte connection causing OOM errors.

introducing a read timeout in the the connector to fail early when the TCP connection is closed non gracefully and make the window_in_days=1 configuration permanent and maybe make it an official configuration parameter in the Marketplace connector

### Relevant log output

```shell

```

### Contribute

- [ ] Yes, I want to contribute

---
**Internal Tracking:** https://github.com/airbytehq/oncall/issues/12739

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.