[source-greenhouse] Hitting rate limit - auto retry does not work over several hours
- Langage dominant
- Python
- Étoiles
- 22.1k
- Forks
- 5.4k
- Merge moyen
- 5 h
- PR mergées (30 j)
- 671
Description
### Connector Name
source-greenhouse
### Connector Version
0.4.4
### What step the error happened?
During the sync
### Relevant information
I have tried running the Greenhouse source connector both locally and on Airbyte Cloud. These logs are from cloud. In both cases, the API key is used exclusively by Airbyte. After running without any issue for several minutes, the sync gets stuck in an endless loop of hitting rate limits, and does not seem to any longer be syncing new records. The same instances work fine with other sources such as Salesforce, Asana and Airtable.
[ruan_kunaico_com_job_8207341_attempt_1_txt.txt](https://github.com/airbytehq/airbyte/files/14204917/ruan_kunaico_com_job_8207341_attempt_1_txt.txt)
### Relevant log output
```shell
2024-02-08 06:06:35 source > Backing off _send(...) for 0.0s (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://harvest.greenhouse.io/v1/applications/13224851007/demographics/answers?per_page=100&updated_after=1970-01-01T00%3A00%3A00.000Z, Response Code: 429, Response Text: {"message":"Rate limit exceeded"})
2024-02-08 06:06:35 source > Retrying. Sleeping for 10 seconds
2024-02-08 06:06:21 platform > Workload ec8171fb-6244-4190-9ebd-385d89de4632_8207341_0_sync is running
2024-02-08 06:06:55 source > Backing off _send(...) for 0.0s (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://harvest.greenhouse.io/v1/applications/13262416007/demographics/answers?per_page=100&updated_after=1970-01-01T00%3A00%3A00.000Z, Response Code: 429, Response Text: {"message":"Rate limit exceeded"})
2024-02-08 06:06:55 source > Retrying. Sleeping for 10 seconds
2024-02-08 06:06:56 destination > 2024-02-08 06:06:56 INFO i.a.c.i.d.b.BufferManager(printQueueInfo):118 - [ASYNC QUEUE INFO] Global: max: 742.41 MB, allocated: 4.7 MB (4.696633338928223 MB), % used: 0.006326230872824983 | Queue `applications`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | State Manager memory usage: Allocated: 4 MB, Used: -5560983 bytes, percentage Used -1.129185
2024-02-08 06:06:56 destination > 2024-02-08 06:06:56 INFO i.a.c.i.d.FlushWorkers(printWorkerInfo):146 - [ASYNC WORKER INFO] Pool queue size: 0, Active threads: 0
2024-02-08 06:06:59 replication-orchestrator > Sending workload heartbeat
2024-02-08 06:07:15 source > Backing off _send(...) for 0.0s (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://harvest.greenhouse.io/v1/applications/13246830007/demographics/answers?per_page=100&updated_after=1970-01-01T00%3A00%3A00.000Z, Response Code: 429, Response Text: {"message":"Rate limit exceeded"})
2024-02-08 06:07:15 source > Retrying. Sleeping for 10 seconds
2024-02-08 06:07:34 source > Backing off _send(...) for 0.0s (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://harvest.greenhouse.io/v1/applications/13262708007/demographics/answers?per_page=100&updated_after=1970-01-01T00%3A00%3A00.000Z, Response Code: 429, Response Text: {"message":"Rate limit exceeded"})
2024-02-08 06:07:34 source > Retrying. Sleeping for 10 seconds
2024-02-08 06:07:55 source > Backing off _send(...) for 0.0s (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://harvest.greenhouse.io/v1/applications/13223738007/demographics/answers?per_page=100&updated_after=1970-01-01T00%3A00%3A00.000Z, Response Code: 429, Response Text: {"message":"Rate limit exceeded"})
2024-02-08 06:07:55 source > Retrying. Sleeping for 10 seconds
2024-02-08 06:07:56 destination > 2024-02-08 06:07:56 INFO i.a.c.i.d.b.BufferManager(printQueueInfo):118 - [ASYNC QUEUE INFO] Global: max: 742.41 MB, allocated: 4.7 MB (4.696633338928223 MB), % used: 0.006326230872824983 | Queue `applications`, num records: 0, num bytes: 0 bytes, allocated bytes: 0 bytes | State Manager memory usage: Allocated: 4 MB, Used: -5560983 bytes, percentage Used -1.129185
2024-02-08 06:07:56 destination > 2024-02-08 06:07:56 INFO i.a.c.i.d.FlushWorkers(printWorkerInfo):146 - [ASYNC WORKER INFO] Pool queue size: 0, Active threads: 0
2024-02-08 06:07:59 replication-orchestrator > Sending workload heartbeat
2024-02-08 06:08:14 source > Backing off _send(...) for 0.0s (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://harvest.greenhouse.io/v1/applications/13224905007/demographics/answers?per_page=100&updated_after=1970-01-01T00%3A00%3A00.000Z, Response Code: 429, Response Text: {"message":"Rate limit exceeded"})
2024-02-08 06:08:14 source > Retrying. Sleeping for 10 seconds
2024-02-08 06:08:35 source > Backing off _send(...) for 0.0s (airbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Request URL: https://harvest.greenhouse.io/v1/applications/13220623007/demographics/answers?per_page=100&updated_after=1970-01-01T00%3A00%3A00.000Z, Response Code: 429, Response Text: {"message":"Rate limit exceeded"})
2024-02-08 06:08:35 source > Retrying. Sleeping for 10 seconds
```
### Contribute
- [ ] Yes, I want to contribute
Guide de contribution
Ouvrir le guide de contribution
Évaluation
Cette issue n'a pas encore été évaluée.