airbytehq / airbytehq/airbyte

Source Twilio: handler to improve performance

Abierto
#10,845 3 comentarios 0 reacciones 0 asignados Ver en GitHub
autoteam community connectors/source/twilio frozen team/marketplace team/use
Lenguaje dominante
Python
Estrellas
22.1k
Forks
5.3k
Métricas de merge de PR
Métricas de PR pendientes

Descripción

## Tell us about the problem you're trying to solve
Twilio's API has a rate limit per request in a certain period of time. After a long-running sync process, it seems that enters into a backoff loop, and finally, when it reaches the sixth attempt the process fails and starts over again since the beginning. This happens when we try to synchronize large amounts of information, for example with the messages that we could have hundreds of millions.

## Describe the solution you’d like
One type of handler that enables to improve the connector's sync, maybe to have a sleep time after making 6 backoff retries or have more than 6 retries to renew this quota limit and don't finish the whole process.

- Slack [thread](https://airbytehq.slack.com/archives/C01MFR03D5W/p1646336439852449)

Guía de contribución

Abrir la guía de contribución

Evaluación

Este issue todavía no se ha evaluado.

Recibe los nuevos issues en tu correo

Un resumen breve de issues de GitHub para principiantes.