apache / apache/arrow-rs-object-store

Cross Bucket Copy Support

Open
#297 10 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Rust
Stars
322
Forks
212
Avg merge
5d 2h
Merged PRs (30d)
10

Description

_Draft as needs further design, and a motivating use-case_

**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**

Currently ObjectStore only supports copying files within the current bucket, this is despite most stores having APIs for performing efficient copies across buckets within the same cloud provider.

**Describe the solution you'd like**

I would like some mechanism to support copying between ObjectStore, that is able to make use of the more efficient APIs where they are possible. I don't have a good idea of how to achieve this, nor a motivating use-case for this functionality.

**Describe alternatives you've considered**

**Additional context**

Contributor guide

Open the contributing guide

Research direction

Start with the existing ObjectStore copy operation and compare how supported stores expose same-provider cross-bucket copy APIs. Define a motivating use case and settle the API and design boundaries; done requires an agreed design that can express cross-bucket copies while preserving efficient provider-side operations where available.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
cloud
Issue type
Feature
Difficulty
5/5
Estimated time
Over a week
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.