envoyproxy / envoyproxy/gateway

[ circuit breakers][BackendTrafficPolicy] On specific backend services, reaching these thresholds did not result in queuing or speed limits.

Aperta
#5,942 7 commenti 0 reazioni 0 assegnatari Vedi su GitHub
stale triage
Lingua principale
Go
Stelle
3k
Fork
864
Merge medio
2g 2h
PR unite (30g)
140

Descrizione

*Description*:
@zirain After creating httproute and configuring circuit breakers, it did not take effect.Senting 16 and 32 concurrent 100 requests respectively, and did not see any intercepted or queued requests
```
apiVersion: gateway.envoyproxy.io/v1alpha1
kind: BackendTrafficPolicy
metadata:
creationTimestamp: "2025-05-07T07:42:16Z"
generation: 1
name: circuitbreaker-for-route
namespace: aibrix-system
resourceVersion: "38457697"
uid: 88c52866-dca5-44fa-ae4b-bb21fb026a58
spec:
circuitBreaker:
maxConnections: 1024
maxParallelRequests: 20
maxParallelRetries: 1024
maxPendingRequests: 10
targetRefs:
- group: gateway.networking.k8s.io
kind: HTTPRoute
name: deepseek-r1-distill-llama-8b-act6be-router
status:
ancestors:
- ancestorRef:
group: gateway.networking.k8s.io
kind: Gateway
name: aibrix-eg
namespace: aibrix-system
conditions:
- lastTransitionTime: "2025-05-07T07:42:16Z"
message: Policy has been accepted.
reason: Accepted
status: "True"
type: Accepted
controllerName: gateway.envoyproxy.io/gatewayclass-controller
---
apiVersion: gateway.networking.k8s.io/v1
kind: HTTPRoute
metadata:
creationTimestamp: "2025-05-06T11:48:43Z"
generation: 1
name: deepseek-r1-distill-llama-8b-act6be-router
namespace: aibrix-system
resourceVersion: "37414750"
uid: cc0c2f1c-2efd-4695-826d-fea10b25684c
spec:
parentRefs:
- group: gateway.networking.k8s.io
kind: Gateway
name: aibrix-eg
namespace: aibrix-system
rules:
- backendRefs:
- group: ""
kind: Service
name: deepseek-r1-distill-llama-8b-act6be
namespace: prdsafe
port: 8000
weight: 1
matches:
- headers:
- name: model
type: Exact
value: deepseek-r1-distill-llama-8b-act6be
path:
type: PathPrefix
value: /v1/completions
- headers:
- name: model
type: Exact
value: deepseek-r1-distill-llama-8b-act6be
path:
type: PathPrefix
value: /v1/chat/completions
timeouts:
request: 120s
status:
parents:
- conditions:
- lastTransitionTime: "2025-05-06T11:48:43Z"
message: Route is accepted
observedGeneration: 1
reason: Accepted
status: "True"
type: Accepted
- lastTransitionTime: "2025-05-06T11:48:43Z"
message: Resolved all the Object references for the Route
observedGeneration: 1
reason: ResolvedRefs
status: "True"
type: ResolvedRefs
controllerName: gateway.envoyproxy.io/gatewayclass-controller
parentRef:
group: gateway.networking.k8s.io
kind: Gateway
name: aibrix-eg
namespace: aibrix-system
```
[optional *Relevant Links*:]

Guida per i contributori

Nessuna guida per i contributori indicizzata per questo repository

Valutazione

Questa issue non è ancora stata valutata.

Ricevi le nuove issue nella tua casella

Un breve riepilogo di issue GitHub adatte ai principianti.