airbytehq / airbytehq/airbyte

Source Twilio: handler to improve performance

未關閉
#10,845 3 則留言 0 個 reaction 已指派 0 人 在 GitHub 檢視
autoteam community connectors/source/twilio frozen team/marketplace team/use
主要語言
Python
星號
22.1k
分支
5.4k
平均合併
5 小時
30 天內合併 PR
671

描述

## Tell us about the problem you're trying to solve
Twilio's API has a rate limit per request in a certain period of time. After a long-running sync process, it seems that enters into a backoff loop, and finally, when it reaches the sixth attempt the process fails and starts over again since the beginning. This happens when we try to synchronize large amounts of information, for example with the messages that we could have hundreds of millions.

## Describe the solution you’d like
One type of handler that enables to improve the connector's sync, maybe to have a sleep time after making 6 backoff retries or have more than 6 retries to renew this quota limit and don't finish the whole process.

- Slack [thread](https://airbytehq.slack.com/archives/C01MFR03D5W/p1646336439852449)

貢獻指南

開啟貢獻指南

評估

這個 Issue 還沒有評估資料。

把新 issue 寄到你的電子郵件信箱

精選適合新手參與的 GitHub issue 摘要。