Proxy monitors its own load/health and throttles connections when required
Open
Priority:1
Type: Enhancement
Type: Idea
User Story
- Dominant language
- C#
- Stars
- 9.6k
- Forks
- 933
- Avg merge
- 12d 18h
- Merged PRs (30d)
- 2
Description
Add self-diagnostics capability to YARP and implement throttling policies which can be applied if some thresholds have been exceeded.
Indicators to watch for:
- CPU load
- Memory pressure
- Available TCP ports
- Average/mean/p95 client requests latency
Examples of throttling policies:
- Stop accepting new HTTP 1.1 requests by immediately returning 503
- Stop accepting new active streams on HTTP/2 connections
- Stop accepting new TCP connections
Contributor guide
Assessment
This issue has not been assessed yet.