Azure / Azure/Azurite

Performance (wishlist)

Open
#1,117 6 comments 0 reactions 1 assignee Claimed by @Poku8 View on GitHub
NewArch performance stale
Dominant language
TypeScript
Stars
2.3k
Forks
393
Avg merge
1d 20h
Merged PRs (30d)
36

Description

Since the readme says "Please reach to us if you have requirements or suggestions for a distributed Azurite implementation or higher performance." here goes ...

My use case is testing a data processing/aggregation/analysis pipeline and I can't do this without using a lot of data locally. I have been able to run locally using the former Azure Storage Emulator which has adequate performance for my task. I have tried switching to Azurite (now it has table support) but I find it grinds to an almost complete halt once there are tens of thousands of messages in queues or rows in tables. It's fine because I can continue using the old emulator for now (I just downloaded the installer again in case it disappears) but perhaps it will one day not support some key aspect of Azure Storage.

So my wish list:
Simple Windows installer, no dependency on installing node.js or docker.
Uses a database (SQL server for me) for all data and metadata, or has a disk-based storage mechanism with similar performance for multiple thread insertion and deletion of queue messages / table rows / block blobs in large number.
Option to store block blobs in a folder rather than the database to minimise database size, files to be stored individually on disk, replicating folder structure in Azure Storage. Metadata still in database presumably.
Data survives upgrades/reinstallation of Azurite.

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.