apache / apache/arrow-rs-object-store

Why doesn't list_with_delimiter yield a BoxStream?

Open
#361 1 comment 0 reactions 0 assignees View on GitHub
question
Dominant language
Rust
Stars
322
Forks
212
Avg merge
5d 2h
Merged PRs (30d)
10

Description

**Which part is this question about**

I was curious why the list and list_with_delimiter functions on the `ObjectStore` don't have the same return type 🤔

I have some ... storage with literally billions of objects The response of a ListResult from list_with_delimiter I don't understand while `list` provides a BoxStream, which I presume to be yielding results from paginated calls to the underlying storage provider.

Contributor guide

Open the contributing guide

Research direction

Start by locating the ObjectStore implementations of list and list_with_delimiter, then inspect the ListResult and BoxStream types and their pagination-related tests or documentation. Clarify the intended difference in return behavior and record the explanation where users can find it; done means the API distinction and handling of large listings are understandable.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
backend-api-design
Issue type
Documentation
Difficulty
3/5
Estimated time
1-2 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.