apache / apache/arrow

[Python] AWS SDK 1.11 support in pyarrow wheels?

Open
#42,154 14 comments 4 reactions 0 assignees View on GitHub
Component: Python Type: bug
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

### Describe the bug, including details regarding any error messages, version, and platform.

With regard to https://github.com/apache/arrow/issues/40262, is there a plan to update `pyarrow`'s AWS SDK dependency from 1.10 to 1.11? We believe from
https://github.com/apache/arrow/blob/fe4d04f081e55ca2de7b1b67b10ad7dca96cfd9e/cpp/thirdparty/versions.txt#L54
that `pyarrow` is currently using 1.10:
```
ARROW_AWSSDK_BUILD_VERSION=1.10.55
```

It appears that a mitigation for https://github.com/apache/arrow/issues/40262 is in AWS SDK 1.11:
https://github.com/aws/aws-sdk-cpp/pull/2710

(There's significant backstory on https://github.com/single-cell-data/TileDB-SOMA/pull/2692 and on https://github.com/TileDB-Inc/tiledbsoma-feedstock/pull/171, if backstory is desired. A repro is here: https://github.com/single-cell-data/TileDB-SOMA/pull/2692#issuecomment-2153450984.)

cc @pitrou

### Component(s)

Python

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.