envoyproxy / envoyproxy/gateway
[ circuit breakers][BackendTrafficPolicy] On specific backend services, reaching these thresholds did not result in queuing or speed limits.
- Lingua principale
- Go
- Stelle
- 3k
- Fork
- 864
- Merge medio
- 2g 2h
- PR unite (30g)
- 140
Descrizione
*Description*:
@zirain After creating httproute and configuring circuit breakers, it did not take effect.Senting 16 and 32 concurrent 100 requests respectively, and did not see any intercepted or queued requests
```
apiVersion: gateway.envoyproxy.io/v1alpha1
kind: BackendTrafficPolicy
metadata:
creationTimestamp: "2025-05-07T07:42:16Z"
generation: 1
name: circuitbreaker-for-route
namespace: aibrix-system
resourceVersion: "38457697"
uid: 88c52866-dca5-44fa-ae4b-bb21fb026a58
spec:
circuitBreaker:
maxConnections: 1024
maxParallelRequests: 20
maxParallelRetries: 1024
maxPendingRequests: 10
targetRefs:
- group: gateway.networking.k8s.io
kind: HTTPRoute
name: deepseek-r1-distill-llama-8b-act6be-router
status:
ancestors:
- ancestorRef:
group: gateway.networking.k8s.io
kind: Gateway
name: aibrix-eg
namespace: aibrix-system
conditions:
- lastTransitionTime: "2025-05-07T07:42:16Z"
message: Policy has been accepted.
reason: Accepted
status: "True"
type: Accepted
controllerName: gateway.envoyproxy.io/gatewayclass-controller
---
apiVersion: gateway.networking.k8s.io/v1
kind: HTTPRoute
metadata:
creationTimestamp: "2025-05-06T11:48:43Z"
generation: 1
name: deepseek-r1-distill-llama-8b-act6be-router
namespace: aibrix-system
resourceVersion: "37414750"
uid: cc0c2f1c-2efd-4695-826d-fea10b25684c
spec:
parentRefs:
- group: gateway.networking.k8s.io
kind: Gateway
name: aibrix-eg
namespace: aibrix-system
rules:
- backendRefs:
- group: ""
kind: Service
name: deepseek-r1-distill-llama-8b-act6be
namespace: prdsafe
port: 8000
weight: 1
matches:
- headers:
- name: model
type: Exact
value: deepseek-r1-distill-llama-8b-act6be
path:
type: PathPrefix
value: /v1/completions
- headers:
- name: model
type: Exact
value: deepseek-r1-distill-llama-8b-act6be
path:
type: PathPrefix
value: /v1/chat/completions
timeouts:
request: 120s
status:
parents:
- conditions:
- lastTransitionTime: "2025-05-06T11:48:43Z"
message: Route is accepted
observedGeneration: 1
reason: Accepted
status: "True"
type: Accepted
- lastTransitionTime: "2025-05-06T11:48:43Z"
message: Resolved all the Object references for the Route
observedGeneration: 1
reason: ResolvedRefs
status: "True"
type: ResolvedRefs
controllerName: gateway.envoyproxy.io/gatewayclass-controller
parentRef:
group: gateway.networking.k8s.io
kind: Gateway
name: aibrix-eg
namespace: aibrix-system
```
[optional *Relevant Links*:]
Guida per i contributori
Nessuna guida per i contributori indicizzata per questo repository
Valutazione
Questa issue non è ancora stata valutata.