lance-format / lance-format/lance
Multi-base with the same bucket name in different storage accounts
@westonpace is already working on this.
Since Mar 20, 2026.
- Dominant language
- Rust
- Stars
- 7.1k
- Forks
- 852
- Avg merge
- 3d 18h
- Merged PRs (30d)
- 272
Description
For Azure, different storage accounts can have buckets (containers) of the same name. Also storage account is the unit of rate limit cap.
When expressed as base, today we try to match base based on the prefix, and that would mean it can only match 1 bucket but not the others if user defines multiple bases of the same buckets in different storage accounts.
We need the ability to define storage_options as a part of the base definition, so that we can express something like
message BasePath {
uint32 id = 1;
optional string name = 2;
bool is_dataset_root = 3;
string path = 4;
map<string, string> storage_options = 5;
}
Also related to https://github.com/lance-format/lance/issues/6093, if user need to use different credentials to access different storage accounts.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.