apache / apache/datafusion-python

Allow setting `ClientOptions` for `datafusion.object_store` contexts

Open
#1,082 0 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
604
Forks
174
Avg merge
1d 7h
Merged PRs (30d)
4

Description

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
(This section helps Arrow developers understand the context and *why* for this feature, in addition to the *what*)

Currently, there doesn't seem to be a way to set the `ClientOptions` used by the object store contexts from Python. This limits configurability and can lead to issues like connection/request timeouts and incorrectly configured CA hampering usage in some setups - especially corporate or multi-cloud setups.

**Describe the solution you'd like**
A clear and concise description of what you want to happen.

Let's expose passing `ClientOption` in for all `datafusion.object_store` contexts (e.g. `PyAmazonS3Context`, `PyGoogleCloudContext`, etc).

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.