Azure / Azure/azure-functions-host

Getting very high latency ~1day for events from IOT hub

Open
#3,708 2 comments 0 reactions 0 assignees View on GitHub
Dominant language
C#
Stars
2k
Forks
482
Avg merge
2d 12h
Merged PRs (30d)
38

Description

I have Azure Functions triggered by events from IOT hub. I am experiencing latencies up to 1 day from event enqueued time to function invocation.

#### Investigative information

Please provide the following:

- Timestamp: 2018-10-28T13:01:39.453Z
- Function App version (1.0 or 2.0): 1.0
- Function App name: Subscription 32483011-f64d-455e-b336-212fa95c1813
- Function name(s) (as appropriate): PlatformEventHandlerColdPath
- Invocation ID: 099c81a9-bd6b-459e-90b2-3712762ed667
- Region: South Central US

#### Expected behavior
Event latency to not exceed e.g. 1 minute

#### Actual behavior
In my function (invocation as above), if I compare DateTime.UtcNow with event enqueued time I get latency of 1day 23 mins.
The actual duration of the call is ~500ms.

#### Related information

* Programming language used: C#
* The function accesses BLOB data is storage account as well as Azure tables. Then does some processing and writes data back into Azure tables.
* I created trace writer to Azure table in order to debug this. Attached is trace output for the above invocation.

[Uploading TraceEntry.xlsx…]()

Contributor guide

Open the contributing guide

Research direction

Start with the reported PlatformEventHandlerColdPath invocation, using the timestamp, invocation ID, region, and attached TraceEntry.xlsx to compare event enqueue and function invocation times. Reproduce or trace the delay in the Azure Functions and IoT Hub path; done means identifying the cause of the nearly one-day latency and documenting a validated resolution.

Written by the indexing model from the issue text.

Assessment

Tech stack
azure, csharp
Domain
backend, cloud
Issue type
Bug
Difficulty
4/5
Estimated time
3-5 days
Activity status
Stale
Clarity
Needs clarification
Newbie friendliness
20/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.