[feature] make a UI-first LLM API security gateway

Refer to:

Tier 1 — 40k+ stars

| Project | Stars | Language | Notes |
|---|---|---|---|
| [[BerriAI/litellm](https://github.com/BerriAI/litellm)](https://github.com/BerriAI/litellm) | 53.5k | Python | Unified OpenAI-format access to 100+ LLM APIs, with cost tracking, guardrails, load balancing, and logging. The de facto standard; largest community. MIT. |
| [[Kong/kong](https://github.com/Kong/kong)](https://github.com/Kong/kong) | 43.8k | Lua | Established API gateway that added AI gateway capabilities. Most stars are legacy, not AI-driven. |
| [[QuantumNous/new-api](https://github.com/QuantumNous/new-api)](https://github.com/QuantumNous/new-api) | 42.1k | Go | Model aggregation and distribution hub; cross-converts LLMs into OpenAI-, Claude-, or Gemini-compatible formats. Dominant in the Chinese-speaking community. Successor to `songquanpeng/one-api`. |

## Tier 2 — 10k–25k stars

| Project | Stars | Language | Notes |
|---|---|---|---|
| [[decolua/9router](https://github.com/decolua/9router)](https://github.com/decolua/9router) | 22k | JavaScript | Free-tier aggregation: connects Claude Code, Codex, Cursor, Cline, and Copilot to 40+ providers with auto-fallback. |
| [[apache/apisix](https://github.com/apache/apisix)](https://github.com/apache/apisix) | 16.9k | Lua | Cloud-native API gateway that also serves as an AI gateway. |
| [[diegosouzapw/OmniRoute](https://github.com/diegosouzapw/OmniRoute)](https://github.com/diegosouzapw/OmniRoute) | 16.7k | TypeScript | 231+ providers, token compression, MCP/A2A support, desktop and PWA clients. Same niche as 9router. |
| [[Portkey-AI/gateway](https://github.com/Portkey-AI/gateway)](https://github.com/Portkey-AI/gateway) | 12.4k | TypeScript | Routes to 1,600+ LLMs with 50+ built-in guardrails. Apache 2.0; production-safety focus. |