danielgerlag / danielgerlag/workflow-core

7k requests a minute to azure blob storage

Open
#1,263 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
C#
Stars
5.9k
Forks
1.3k
Avg merge
1d 1h
Merged PRs (30d)
5

Description

**Describe the bug**
I have a 4-node setup that utilizes Azure ServiceBus event hub, AzureSynchronization, and CosmosDbPersistance. Under minimal load (eg no active workflows) I'm getting a constant throughput of 7,000 requests to azure blob storage, consuming about 8mb per minute. Specifically it's calls to GetMessageRead that's happening.

**To Reproduce**
Create a workflow core service in Kubernetes with multiple nodes, utilizing all features of the azure extensions.

**Expected behavior**
Less than 7k transactions a minute on an idle workflow instance.

**Additional context**
It will bump up to 10k requests when busy, but only ever drops back down to 7k a minute.

Contributor guide

No contributing guide indexed for this repository

Research direction

Reproduce the four-node Kubernetes setup using Azure ServiceBus event hub, AzureSynchronization, and CosmosDbPersistance, then measure idle Azure Blob Storage traffic. Start by tracing the GetMessageRead calls and compare idle versus busy behavior. Done means an idle workflow instance stays below 7,000 transactions per minute without breaking active processing.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, csharp
Domain
backend, cloud
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Mostly clear
Newbie friendliness
35/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.