envoyproxy / envoyproxy/gateway

Rate Limiting Pod Creation Delay Causes 500 Errors

Open
#8,796 11 comments 0 reactions 0 assignees View on GitHub
stale triage
Dominant language
Go
Stars
3k
Forks
864
Avg merge
2d 2h
Merged PRs (30d)
140

Description

### Description

When enabling rate limiting, the pod creation for the rate limiting service takes a bit of time, and all incoming requests fail with HTTP 500 errors.

### Environment

- Envoy Gateway version: 1.7.1
- Kubernetes version: 1.33
- Rate limiter backend: elasticache valkey 8
- Cloud provider / platform: EKS

### Steps to Reproduce

1. Deploy Envoy Gateway with rate limiting enabled
2. Send requests to a route that has a `RateLimitFilter` applied during the deployment.
3. Observe that requests return HTTP 500 until the pod is fully ready.

### Expected Behavior

Requests should not fail with 500 errors while the rate limiting pod is not yet created, envoy gateway should handle the traffic properly

### Actual Behavior

All requests return HTTP 500 before the rate limiting pod is created.

**NB: when scaling the pod down the traffic is still handled fine, so this is happening just during the initial deployment.**

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.