Azure / Azure/azure-functions-host

Investigate Large SyncTriggers Payloads

Open
#4,691 0 comments 0 reactions 1 assignee Claimed by @mathewc View on GitHub
Dominant language
C#
Stars
2k
Forks
482
Avg merge
2d 10h
Merged PRs (30d)
36

Description

We're seeing failures in the Front End logs for a small percentage of customers where their SyncTriggers calls are being rejected due to the payload being too large. We need to investigate some of the customers with extremely large payloads to see what is pushing them over limit. There might be fixes we need to make in the construction of the payload to exclude some things.

To find some of the biggest offenders, runt the following Kusto query and look for the requests with the largest Cs_bytes:

AntaresIISLogFrontEndTable
| where PreciseTimeStamp >= ago(5h)
| where Cs_uri_stem == "/operations/settriggers"
| where Sc_status == 400
| order by Cs_bytes desc

We've made changes in ANT 84 to double the limit from 102400 bytes to 204800 bytes which satisfies the 95th percentile. Likely it is only error cases hitting the limit in these cases. We should investigate some apps and see what is causing the extremely large payloads. It might be:

- test_data being included in the payload. E.g. if the user has large test data files. Does the portal even need this data anymore? We could stop sending it
- too many secrets being sent (encrypted). e.g. perhaps in some cases there are a bunch of secrets backup files being sent along

See related PR https://github.com/Azure/azure-functions-host/pull/4676.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.