vllm-project / vllm-project/aibrix

Add other service discovery methods like etcd or consul in AIBrix router

Open
#2,033 1 comment 0 reactions 0 assignees View on GitHub
area/gateway priority/critical-urgent
Dominant language
Go
Stars
5.1k
Forks
694
Avg merge
1d 20h
Merged PRs (30d)
98

Description

### 🚀 Feature Description and Motivation

related to https://github.com/vllm-project/aibrix/issues/2031

for environments without permission to create services or users who leverage external service discovery solutions (etcd, consul), we should provide a service discovery solution

### Use Case

see above

### Proposed Solution

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.