airbytehq / airbytehq/airbyte

Source Intercom: Support high volume syncs

Offen
#11,595 14 Kommentare 0 Reaktionen 0 zugewiesene Personen Auf GitHub ansehen
autoteam connectors/source/intercom connectors/sources-api frozen team/connectors-python team/extensibility type/enhancement zendesk
Vorherrschende Sprache
Python
Sterne
22.1k
Forks
5.3k
PR-Merge-Kennzahlen
PR-Kennzahlen ausstehend

Beschreibung

## Tell us about the problem you're trying to solve
A user was trying to sync a high volume instance of Intercom (logs below). The connector spent many hours (50+ hours) syncing data from the contacts stream. This is a bad user experience as it does not allow them to make use of the product and data quickly.
[logs-97415.txt](https://github.com/airbytehq/airbyte/files/8383210/logs-97415.txt)

Note that this issue is not just trying to do this for intercom, but should be used as a learning opportunity for how this can be done at the CDK level as described in airbytehq/airbyte-internal-issues#504

## Describe the solution you’d like
I would like us to find a way to speed up intercom syncs coming from high volume instances such as this one. Ideally a sync takes no longer than a couple of hours in 99% of cases.

Beitragsleitfaden

Beitragsleitfaden öffnen

Bewertung

Dieses Issue wurde noch nicht bewertet.

Neue Issues direkt in Ihr Postfach

Eine kurze Übersicht über anfängerfreundliche GitHub-Issues.