envoyproxy / envoyproxy/gateway

Best Practices for Load Shedding in Envoy Gateway

未关闭
#9,653 3 条评论 0 个 reaction 已指派 0 人 在 GitHub 查看
stale triage
主要语言
Go
星标
3k
派生
868
平均合并
1 天 20 小时
30 天内合并 PR
134

描述

Hello,

I'm looking for guidance on implementing load shedding in Envoy Gateway to protect backend services under high load.

In networking, mechanisms such as Random Early Detection (RED) and traffic policing proactively prevent congestion by dropping or limiting traffic before the network becomes saturated. I'm looking for the equivalent approach for HTTP/API traffic using Envoy Gateway.

Specifically, I'd like to know:

Does Envoy Gateway support proactive load shedding based on resource pressure (e.g., request latency, concurrency, queue depth, CPU utilization, or other overload signals)?
Is Envoy's adaptive concurrency filter currently supported and configurable through Envoy Gateway?
What is the recommended way to reject excess requests before backend services become overloaded?
Are there best practices for combining:
Local or global rate limiting
Circuit breakers
Adaptive concurrency
Overload Manager
Kubernetes HPA
If some of these capabilities are not yet exposed by Envoy Gateway, what is the recommended production approach today?

Our goal is not only to enforce rate limits, but to gracefully shed load when the platform approaches its safe operating capacity, ensuring that the system remains responsive instead of allowing latency to grow until services become unavailable.

If there are existing examples, documentation, or recommended configuration patterns for this use case, I would greatly appreciate being pointed to them.

Thank you!

贡献指南

这个仓库没有索引到贡献指南

调研方向

Issue 中没有确定文件、测试或入口点。首先查看 Envoy Gateway 现有的文档,以及对 rate limiting、circuit breakers、adaptive concurrency、Overload Manager 和 Kubernetes HPA 的配置支持;完成的标准是记录哪些功能受到支持,以及推荐的生产环境负载卸载方法。

由索引模型根据 Issue 内容生成。

评估

技术栈
kubernetes
领域
backend-api-design, networking
Issue 类型
文档
难度
5/5
预计耗时
一周以上
活跃度
活跃
描述清晰度
需要澄清
新手友好度
35/100

把新 issue 发到你的邮箱

精选适合新手参与的 GitHub issue 摘要。