vllm-project / vllm-project/aibrix
RFC: Add Leader Election Support for Active-Passive Architecture in Gateway plugin
Open
@googs1025 is already working on this.
Since Nov 26, 2025.
area/gateway
kind/enhancement
priority/important-soon
- Dominant language
- Go
- Stars
- 5.1k
- Forks
- 697
- Avg merge
- 1d 19h
- Merged PRs (30d)
- 104
Description
🚀 Feature Description and Motivation
Currently, the gateway plugin doesn't support leader election, which means all instances are active simultaneously.
This can lead to:
- Inconsistent KV cache event processing across multiple instances
- Potential race conditions when handling shared resources
- No high availability with failover capabilities
Use Case
high availability with failover capabilities
Proposed Solution
Implement leader election support to enable an active-passive (leader-follower) architecture where only one instance is active at a time while others remain in standby mode.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.