apache / apache/arrow

[Python][C++] Add Profile support to S3FileSystem

Open
#47,880 4 comments 1 reaction 0 assignees View on GitHub
Component: Python Type: enhancement
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

### Describe the enhancement requested

`pyarrow.fs.S3FileSystem` works fine if you're willing to pull temporary credentials and create this client manually

This comes with inconvenience such as having to recreate this client periodically as the temporary credentials expire.

In particular it is something that is necessary to do when set up using multiple profiles, as currently there is no way to select a profile and use the underlying SDK machinery to use/refresh the credentials given the profile.

Please add support for this

### Component(s)

Python

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.