drivendataorg / drivendataorg/cloudpathlib
Support SDK-specific retry parameters
Open
enhancement
GCP
S3
- Dominant language
- Python
- Stars
- 628
- Forks
- 88
- Avg merge
- 17h 28m
- Merged PRs (30d)
- 2
Description
Hi there. I tried looking in the docs to see if there was any support for explicitly setting number of retries for the Google Storage Client when writing to a cloud bucket using a `CloudPath` object. Specifically for my use case I am trying to read/write to a GCS bucket many times but I sometimes get a 503 PUT error from GCS, and our infra wants to retry more frequently than the default retry rate for gcs.
Seems like this problem happened before in this issue: https://github.com/drivendataorg/cloudpathlib/issues/267
Contributor guide
Assessment
This issue has not been assessed yet.