vllm-project / vllm-project/aibrix
Token Based Ratelimit Improvement
Open
area/gateway
- Dominant language
- Go
- Stars
- 5.1k
- Forks
- 697
- Avg merge
- 1d 19h
- Merged PRs (30d)
- 104
Description
### 🚀 Feature Description and Motivation
Currently, we support total token usage ratelimit, support input/output token ratelimit
### Use Case
Token Usage
### Proposed Solution
_No response_
Contributor guide
Research direction
The issue does not name files, tests, entry points, or acceptance criteria. Start by locating the existing total-token and input/output-token rate-limit implementation, then clarify the intended token-based behavior before making changes. Done cannot be determined from the current issue text.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go
- Domain
- api, backend, infrastructure
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Stale
- Clarity
- Needs clarification
- Newbie friendliness
- 25/100