quickwit-oss / quickwit-oss/quickwit

Support custom Azure Blob Storage endpoint / endpoint suffix for sovereign clouds

Open
#6,624 2 comments 1 reaction 0 assignees View on GitHub

Nobody has claimed this yet.

enhancement
Dominant language
Rust
Stars
11.7k
Forks
597
Avg merge
2d 22h
Merged PRs (30d)
37

Description

Quickwit currently supports Azure Blob Storage using the following configuration:

storage:
  azure:
    account: <storage-account-name>
    access_key: <storage-account-access-key>

However, there does not appear to be a way to configure a custom Azure Blob Storage endpoint.

This makes it difficult to use Quickwit with Azure environments that do not use the default public Azure endpoints, such as Azure Government, Azure China, Azure Stack, or other Azure deployments with custom endpoints.

I'd like Quickwit to support configuring a custom Azure Blob Storage endpoint so that it can connect to Azure Blob Storage deployments outside the public Azure cloud.

I haven't found an existing configuration option that allows overriding the Azure Blob Storage endpoint in Quickwit. At the moment, the only alternative appears to be modifying Quickwit's source code to add support for custom endpoints.

Azure Blob Storage endpoints vary across Azure cloud environments. For example:

Public Azure: https://.blob.core.windows.net
Azure Government: https://.blob.core.usgovcloudapi.net
Azure China: https://.blob.core.chinacloudapi.cn

Supporting configurable Azure Blob Storage endpoints would enable Quickwit to work seamlessly across Azure sovereign clouds, Azure Stack, and other Azure deployments that expose Blob Storage through non-default endpoints.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Research direction

Start by tracing the storage.azure configuration and the Azure Blob Storage client setup. Determine how a configurable endpoint or endpoint suffix should be represented, then verify that the listed public, Government, China, and other non-default endpoint forms can be used without source changes.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, rust
Domain
backend, cloud
Issue type
Feature
Difficulty
3/5
Estimated time
1-2 days
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
62/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.