apache / apache/beam

Strengthen retry strategy in GCS Java IO

Open
#19,859 0 comments 0 reactions 0 assignees View on GitHub
bug gcp io java P3
Dominant language
Java
Stars
8.7k
Forks
4.7k
Avg merge
1d 20h
Merged PRs (30d)
196

Description

I have seen a report where an intermittent issue in Java GCS IO have caused error messages without sufficient details, see: BEAM-8173. In addition to BEAM-8173 we should also check whether GCS IO attempts to retry on all retriable status codes [1], and if not - add retries.

https://cloud.google.com/storage/docs/json_api/v1/status-codes#http-status-and-error-codes

cc: [~chamikara]

Imported from Jira [BEAM-8268](https://issues.apache.org/jira/browse/BEAM-8268). Original Jira may contain additional context.
Reported by: tvalentyn.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.