danielgerlag / danielgerlag/workflow-core
7k requests a minute to azure blob storage
- Dominant language
- C#
- Stars
- 5.9k
- Forks
- 1.3k
- Avg merge
- 1d 1h
- Merged PRs (30d)
- 5
Description
**Describe the bug**
I have a 4-node setup that utilizes Azure ServiceBus event hub, AzureSynchronization, and CosmosDbPersistance. Under minimal load (eg no active workflows) I'm getting a constant throughput of 7,000 requests to azure blob storage, consuming about 8mb per minute. Specifically it's calls to GetMessageRead that's happening.
**To Reproduce**
Create a workflow core service in Kubernetes with multiple nodes, utilizing all features of the azure extensions.
**Expected behavior**
Less than 7k transactions a minute on an idle workflow instance.
**Additional context**
It will bump up to 10k requests when busy, but only ever drops back down to 7k a minute.
Contributor guide
No contributing guide indexed for this repository
Research direction
Reproduce the four-node Kubernetes setup using Azure ServiceBus event hub, AzureSynchronization, and CosmosDbPersistance, then measure idle Azure Blob Storage traffic. Start by tracing the GetMessageRead calls and compare idle versus busy behavior. Done means an idle workflow instance stays below 7,000 transactions per minute without breaking active processing.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- azure, csharp
- Domain
- backend, cloud
- Issue type
- Bug
- Difficulty
- 4/5
- Estimated time
- 3-5 days
- Activity status
- Stale
- Clarity
- Mostly clear
- Newbie friendliness
- 35/100