lance-format / lance-format/lance

Multi-base with the same bucket name in different storage accounts

Open
#6,230 2 comments 0 reactions 1 assignee View on GitHub

@westonpace is already working on this.

Since Mar 20, 2026.

enhancement
Dominant language
Rust
Stars
7.1k
Forks
852
Avg merge
3d 18h
Merged PRs (30d)
272

Description

For Azure, different storage accounts can have buckets (containers) of the same name. Also storage account is the unit of rate limit cap.

When expressed as base, today we try to match base based on the prefix, and that would mean it can only match 1 bucket but not the others if user defines multiple bases of the same buckets in different storage accounts.

We need the ability to define storage_options as a part of the base definition, so that we can express something like

message BasePath {
  uint32 id = 1;
  optional string name = 2;
  bool is_dataset_root = 3;
  string path = 4;
  map<string, string> storage_options = 5;
}

Also related to https://github.com/lance-format/lance/issues/6093, if user need to use different credentials to access different storage accounts.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.