api7/aisix

View on GitHub

Open-source AI gateway for LLMs & AI agents, built in Rust. One OpenAI-compatible API for OpenAI, Anthropic, Gemini, Bedrock & more — routing, guardrails, caching, rate limits, observability.

Stars: 157
Forks: 32
Open beginner issues: 0
Indexed issues: 93
Avg merge: 1h 25m
Merged PRs (30d): 145

Dominant language: Rust
License: Apache-2.0
Last GitHub push: Sep 18, 2026
Latest indexed: Sep 20, 2026
Contributing guide: Contributing guide
Code of conduct: No code of conduct
Beginner labels: No beginner labels indexed

Beginner friendly Everything

Open All

93 open issues indexed

Guardrails receive no conversation context and no caller identity Open

Difficulty 5/5 Over a week Newbie friendliness 45/100

api7/aisix#1168 · 1 reaction · Opened Sep 11, 2026
窗口级限流触发 429 时，Retry-After 头问题 Open

Difficulty 3/5 1-2 days Newbie friendliness 70/100

api7/aisix#1157 · Opened Sep 9, 2026
aisix-a2a: an SSE frame whose JSON-RPC envelope spans several data: lines fails the stream Open

Difficulty 4/5 3-5 days Newbie friendliness 58/100

api7/aisix#1143 · Opened Sep 7, 2026
guardrails: scan batch input files per record, not as one lossy text blob Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

api7/aisix#1120 · Opened Sep 3, 2026
build: ship the release binary with frame pointers (-C force-frame-pointers=yes) Open

Difficulty 4/5 3-5 days Newbie friendliness 68/100

api7/aisix#1063 · Opened Aug 28, 2026
guardrails: decide and wire the segment-moderation posture for embeddings/rerank/audio/images/passthrough (semantic + siblings) Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

api7/aisix#1032 · 1 comment · Opened Aug 22, 2026
/v1/completions emits an empty applied_guardrails while its chain does run Open

Difficulty 2/5 1-3 hours Newbie friendliness 88/100

api7/aisix#1030 · Opened Aug 22, 2026
A stream aborted by the guardrail buffer cap reports guardrail_blocked with no policy named Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

api7/aisix#1029 · Opened Aug 22, 2026
bug: on /mcp the guardrail scan text and the mask surface are different texts — block, would_mask and mask disagree Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

api7/aisix#1027 · Opened Aug 22, 2026
legacy empty-provider openai-adapter keys stay route-dependent on unset api_base after #1017 Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

api7/aisix#1019 · Opened Aug 21, 2026
streaming: aborted cross-provider responses and ensemble streams report status 200 instead of 499 Open

bug P2

Difficulty 4/5 3-5 days Newbie friendliness 63/100

api7/aisix#1004 · 1 comment · 1 reaction · Opened Aug 20, 2026
feat(guardrails): multi-lane inference pool for the local-model guardrail Open

enhancement P2

Difficulty 4/5 3-5 days Newbie friendliness 55/100

api7/aisix#1001 · 2 comments · 1 reaction · Opened Aug 19, 2026
test: pin authenticated GET/DELETE on /mcp returning 405 Open

Difficulty 2/5 1-3 hours Newbie friendliness 84/100

api7/aisix#991 · 1 comment · 1 reaction · Opened Aug 19, 2026
build: non-tag images self-report an empty version (option_env! sees Some("")) Open

Difficulty 2/5 1-3 hours Newbie friendliness 84/100

api7/aisix#974 · Opened Aug 13, 2026
perf(build): train the upstream-TLS path in the PGO profile (v2 training shape) Open

enhancement P2

Difficulty 5/5 Over a week Newbie friendliness 35/100

api7/aisix#973 · Opened Aug 13, 2026
build(deps): metrics-exporter-prometheus 0.16 is two minor lines behind; upgrade needs a rig-quantified pass Open

enhancement P2

Difficulty 4/5 3-5 days Newbie friendliness 42/100

api7/aisix#962 · Opened Aug 12, 2026
A2A agent url is not checked for embedded userinfo, unlike the Vertex and Azure api_base Open

Difficulty 2/5 1-3 hours Newbie friendliness 74/100

api7/aisix#956 · 1 comment · 1 reaction · Opened Aug 12, 2026
OtlpHttpFanOut::gc has no callers, so pipelines for deleted exporters are never stopped Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 58/100

api7/aisix#954 · Opened Aug 12, 2026
Upstream errors with an empty body render an empty error.message Open

enhancement P2

Difficulty 2/5 1-3 hours Newbie friendliness 75/100

api7/aisix#952 · 1 comment · 1 reaction · Opened Aug 12, 2026
perf(proxy): skeleton request parsing for large bodies (inline base64 multimodal payloads) Open

enhancement P2

Difficulty 5/5 Over a week Newbie friendliness 35/100

api7/aisix#943 · 1 comment · 1 reaction · Opened Aug 12, 2026
预算限制支持按照 token 维度设置 Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

api7/aisix#920 · 1 comment · Opened Aug 10, 2026
thread-per-core: provider-key TLS clients still use a process-wide pool Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 45/100

api7/aisix#908 · 1 comment · 1 reaction · Opened Aug 7, 2026
e2e suite does not emit coverage; the coverage gate measures unit tests only Open

Difficulty 4/5 3-5 days Newbie friendliness 42/100

api7/aisix#907 · 1 comment · 1 reaction · Opened Aug 7, 2026
Exporter delivery task pins itself to one worker in thread-per-core mode Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

api7/aisix#901 · Opened Aug 6, 2026
docs: clarify internal architecture terminology Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 45/100

api7/aisix#899 · 1 comment · 1 reaction · Opened Aug 5, 2026
Establish the on-CPU profiling workflow: adopt cargo-flamegraph and add a dedicated profiling build profile Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 45/100

api7/aisix#847 · 1 comment · 1 reaction · Opened Jul 30, 2026
flaky test: oauth::second_call_within_expiry_hits_the_cache fails intermittently on CI (cache miss on 2nd sequential call) Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 48/100

api7/aisix#812 · 1 comment · 1 reaction · Opened Jul 23, 2026
ProxyState.config_apply_age defaults fail-open — make the production constructor fail-closed Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

api7/aisix#803 · 1 comment · 1 reaction · Opened Jul 22, 2026
Flaky e2e: status-config reports state=synced with resource_counts not yet populated Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

api7/aisix#793 · Opened Jul 21, 2026
Add configurable user registration via login screen Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

api7/aisix#789 · Opened Jul 20, 2026
Add margin configuration via UI Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

api7/aisix#788 · Opened Jul 20, 2026
Datadog: define a metrics path, then ship a dashboard template Open

enhancement

api7/aisix#772 · 1 comment · 1 reaction · 1 assignee · Opened Jul 15, 2026
Client-IP rate-limit scope and burst allowance Open

enhancement

api7/aisix#770 · 1 assignee · Opened Jul 15, 2026
Cache hit/miss/eviction metrics in the Prometheus registry Open

enhancement

api7/aisix#769 · 1 comment · 1 reaction · 1 assignee · Opened Jul 15, 2026
SNI multi-certificate support, hot certificate reload, and inbound client mTLS Open

enhancement

api7/aisix#768 · 1 assignee · Opened Jul 15, 2026
Normalise prompts before guardrail evaluation (Unicode, homoglyphs, encoded payloads) Open

enhancement

api7/aisix#767 · 1 assignee · Opened Jul 15, 2026
Routing predicates on request size and caller identity, and a data-residency constraint Open

enhancement

api7/aisix#766 · 1 comment · 1 reaction · 1 assignee · Opened Jul 15, 2026
Prompt compression and context-window-aware truncation Open

enhancement

api7/aisix#765 · 1 assignee · Opened Jul 15, 2026
BigQuery exporter for usage and audit logs Open

enhancement

api7/aisix#764 · 1 assignee · Opened Jul 15, 2026
Github releases Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

api7/aisix#739 · 3 comments · Opened Jul 7, 2026
MCP oauth2 upstream auth: support client_secret_basic Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

api7/aisix#692 · Opened Jul 2, 2026
Add a stub MCP upstream test harness for end-to-end /mcp output-path tests Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 52/100

api7/aisix#674 · 1 comment · 1 reaction · Opened Jun 30, 2026
Ensemble: cost/token cap that degrades to a single model (P1) Open

cross-repo enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

api7/aisix#621 · Opened Jun 16, 2026
ensemble streaming usage: fold panel sum once on a synthesized terminal frame (multi-usage-chunk judge over-count) Open

Difficulty 3/5 1-2 days Newbie friendliness 68/100

api7/aisix#617 · 1 comment · 1 reaction · Opened Jun 16, 2026
aisix-obs: object_store sink ignores `endpoint` for GCS — wire `with_base_url` or drop the schema allowance Open

bug cross-repo P1

Difficulty 4/5 3-5 days Newbie friendliness 48/100

api7/aisix#585 · Opened Jun 11, 2026
aisix-obs: report per-exporter delivery health to the control plane + on-demand probe delivery Open

cross-repo enhancement P1

Difficulty 5/5 Over a week Newbie friendliness 35/100

api7/aisix#583 · 2 comments · 1 reaction · Opened Jun 11, 2026
GCS cloud_identity keyless: verify the real round-trip on a GKE/GCE runner (object_store ADC needs the metadata server) Open

P1 real chain test

Difficulty 4/5 3-5 days Newbie friendliness 52/100

api7/aisix#573 · 1 comment · 1 reaction · Opened Jun 9, 2026
obs: byte-aware request chunking for content-capable sinks (Datadog 1 MB/log + 5 MB/request; SLS parity) Open

cross-repo enhancement P1

Difficulty 4/5 3-5 days Newbie friendliness 48/100

api7/aisix#556 · 1 comment · 1 reaction · Opened Jun 8, 2026
[hardening] Wrap ProviderKey.secret (+ guardrail/exporter creds) in a redacting Secret type — make log leakage impossible by construction Open

enhancement priority-normal vulnerability

Difficulty 4/5 3-5 days Newbie friendliness 48/100

api7/aisix#547 · 1 comment · 1 reaction · Opened Jun 8, 2026
Attribute guardrail blocks in telemetry for /v1/responses and /v1/embeddings (Blocked tab under-counts) Open

bug priority-normal

Difficulty 3/5 1-2 days Newbie friendliness 55/100

api7/aisix#543 · 3 comments · 1 reaction · Opened Jun 8, 2026

api7/aisix

Get new issues in your inbox