aws-samples / aws-samples/s3pathlib-project
[Bug]: S3Path is not thread-safe
Open
bug
- Dominant language
- Python
- Stars
- 31
- Forks
- 6
- PR merge metrics
- No merged PRs in 30d
Description
## Describe the Bug
s3path uses a "global" session, therefore all clients are shared by this session. In a multithreaded environment (such as most data orchestration platforms) this causes errors.
...
when running S3Path in for example a kedro session, the connection to AWS is unstable resulting in end_point resolver errors.
...
**Describe your Environment**:
- Operation System: MacOS / Linux
- What Python: Pypi
- Python version: 3.10
- Network environment: cloud
Contributor guide
Assessment
This issue has not been assessed yet.