apache / apache/datafusion

Can table_paths containes different buckets?

Open
#11,899 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Rust
Stars
9.3k
Forks
2.4k
Avg merge
3d 7h
Merged PRs (30d)
344

Description

https://github.com/apache/datafusion/blob/7c41323fa46963a6889adafd5d4a8e43c69291b2/datafusion/core/src/datasource/listing/table.rs#L954

The code here uses the first store to read all `table_paths`. In the `DefaultObjectStoreRegistry`, different buckets correspond to different stores. If table_paths contains different buckets, will this cause a problem?

Contributor guide

Open the contributing guide

Research direction

Start at datafusion/core/src/datasource/listing/table.rs around line 954 and trace how table_paths is read through DefaultObjectStoreRegistry. Verify whether paths from different buckets can be handled by the selected store; done means the behavior is established and any necessary correction or documentation is identified.

Written by the indexing model from the issue text.

Assessment

Tech stack
rust
Domain
backend
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.