apache / apache/datafusion

Datafusion crate lacks features to enable object_store's storage options

Open
#19,191 1 comment 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Rust
Stars
9.3k
Forks
2.4k
Avg merge
3d 7h
Merged PRs (30d)
344

Description

### Is your feature request related to a problem or challenge?

Right now, it is not possible to propagated aws/gcp related features to object_store directly from datafusion main crate

### Describe the solution you'd like

Add `aws` and `gcp` features to do so.
Would require it to be added on `datafusion-common` and `datafusion` crates

### Describe alternatives you've considered

Alternatively user will have to check `object_store` version and add this dependency manually with required features, which is possible, but would require user to always keep `object_store` version in sync with `datafusion` which is not convenient as it is not stable dependency

### Additional context

Let me know if it is acceptable and I'll create PR

Contributor guide

Open the contributing guide

Research direction

Start by reading the feature definitions and object_store dependency configuration in the datafusion-common and datafusion crates. Trace how dependency features are exposed, then verify that enabling the new aws and gcp features propagates to object_store and that the crate checks pass.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
build-system
Issue type
Feature
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Stale
Clarity
Clearly specified
Newbie friendliness
50/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.