apache / apache/arrow

[Python] Allow specifying endpoint_url when using utility function pyarrow.fs.resolve_s3_region

Open
#43,713 2 comments 2 reactions 0 assignees View on GitHub
Component: Python Type: enhancement
Dominant language
C++
Stars
17.1k
Forks
4.3k
Avg merge
3d 13h
Merged PRs (30d)
88

Description

### Describe the enhancement requested

Integration tests can mock s3 using https://pypi.org/project/moto/. If an integration test uses mock s3 to test with "mock-test-bucket" calls to `pyarrow.fs.resolve_s3_region()` will raise an exception saying the bucket doesn't exist because it tries to actually query s3.

**Feature request:** Add a parameter to be able to optionally specify the endpoint url
`pyarrow.fs.resolve_s3_region(endpoint_override="http://localhost:3000")`

### Component(s)

Python

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.