apache / apache/opendal

Stat a dir cloud be super slow on some storage services

Open
#4,426 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
5.4k
Forks
825
Avg merge
1d 14m
Merged PRs (30d)
127

Description

OpenDAL supports [RFC-3243: List Prefix](https://opendal.apache.org/docs/rust/opendal/docs/rfcs/rfc_3243_list_prefix/index.html), ensuring accurate results when users call `stat("path/to/dir")` by retrieving the first item via list. However, this method may be extremely slow or could even time out on certain storage services that do not optimized for the `list_with().limit(1)` operation.

Maybe we should take one step back that make this behavior optional?

Contributor guide

Open the contributing guide

Research direction

Start with the RFC-3243 List Prefix documentation and trace the `stat("path/to/dir")` behavior that retrieves the first item through `list_with().limit(1)`. Determine how this lookup could become optional for storage services where the operation is slow or times out; done means the behavior is configurable without breaking accurate directory results.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
backend
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.