feat: add overload protections to `aibridged`
Open
- Dominant language
- No language data
- Stars
- 3
- Forks
- 0
- PR merge metrics
- No merged PRs in 30d
Description
Operators should be able to protect their `coderd` process (of which `aibridged` is a part) from overload due to excessive aibridge requests.
This can take the form of:
- rate-limits
- maximum concurrency
- circuit-breakers (i.e. if excessive requests result in _upstream_ rate-limits)
- backpressure (sleep + HTTP 429)
Contributor guide
No contributing guide indexed for this repository
Assessment
This issue has not been assessed yet.