apache / apache/arrow-rs-object-store

Re-Authorize Request on Retry

Open
#296 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Rust
Stars
322
Forks
212
Avg merge
5d 2h
Merged PRs (30d)
10

Description

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**

Currently we obtain credentials for a request once and use these to drive an operation to completion. This works, however, puts an upper bound on how long we can retry until the credentials are no longer valid

**Describe the solution you'd like**

We should re-authorize requests on retry. The type machinery to enable this might end up being a touch arcane, especially because of the need to support things like S3 express which have different authorization processes depending on the API methid, but I'd hope this could be encapsulated neatly.

**Describe alternatives you've considered**

**Additional context**

apache/arrow-rs-object-store#41 proposes lowering the min ttl which in turn will lower the maximum retry duration

Contributor guide

Open the contributing guide

Research direction

No files or tests are named. Start by tracing how requests acquire credentials and how retries are coordinated, then examine the authorization differences noted for S3 Express. Done means retried requests re-authorize instead of relying on credentials obtained only at the initial request.

Written by the indexing model from the issue text.

Assessment

Tech stack
aws, rust
Domain
backend, cloud
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.