vllm-project/agentic-api

View on GitHub

Stateful API logic for agentic applications using vLLM

Stars: 289
Forks: 74
Open beginner issues: 0
Indexed issues: 42
Avg merge: 1d 17h
Merged PRs (30d): 93

Dominant language: Rust
License: Apache-2.0
Last GitHub push: Sep 19, 2026
Latest indexed: Sep 19, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue

Beginner friendly Everything

Open All

41 open issues indexed

feat: request, stage, and delivery metrics with a local Collector example (#279 phase 3) Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

vllm-project/agentic-api#340 · Opened Sep 18, 2026
feat: request and execution traces across HTTP, WebSocket, and executor stages (#279 phase 2) Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 20/100

vllm-project/agentic-api#339 · Opened Sep 18, 2026
Make persisted reasoning replay aware of upstream capabilities Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

vllm-project/agentic-api#335 · Opened Sep 18, 2026
Define and implement Responses Programmatic Tool Calling support Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

vllm-project/agentic-api#334 · Opened Sep 18, 2026
Add Responses WebSocket mid-turn steering and automatic continuation Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

vllm-project/agentic-api#333 · Opened Sep 18, 2026
Support async function and custom tool calls across Responses continuations Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

vllm-project/agentic-api#332 · Opened Sep 18, 2026
Support cache-preserving reasoning changes with configuration_update input items Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 28/100

vllm-project/agentic-api#331 · Opened Sep 18, 2026
Preserve Responses prompt-cache controls and service tiers across execution paths Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 38/100

vllm-project/agentic-api#330 · Opened Sep 18, 2026
feat: Add Tavily as a selectable web_search provider Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 70/100

vllm-project/agentic-api#327 · Opened Sep 17, 2026
feat: Add SearXNG as a selectable web_search provider Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 68/100

vllm-project/agentic-api#326 · Opened Sep 17, 2026
Enterprise Readiness Open

enhancement enterprise-readiness

Difficulty 5/5 Over a week Newbie friendliness 20/100

vllm-project/agentic-api#316 · Opened Sep 15, 2026
Add complete multi-round Messages usage accounting Open

enhancement enterprise-readiness

Difficulty 5/5 Over a week Newbie friendliness 38/100

vllm-project/agentic-api#315 · Opened Sep 15, 2026
Preserve request capabilities and transport metadata across execution paths Open

enhancement enterprise-readiness

Difficulty 5/5 Over a week Newbie friendliness 25/100

vllm-project/agentic-api#314 · Opened Sep 15, 2026
Add bounded, validated Messages streaming and tool scheduling Open

enhancement enterprise-readiness

Difficulty 5/5 Over a week Newbie friendliness 35/100

vllm-project/agentic-api#313 · Opened Sep 15, 2026
code clean up / refactor Open

good first issue

Difficulty 5/5 Over a week Newbie friendliness 25/100

vllm-project/agentic-api#312 · 3 comments · Opened Sep 15, 2026
[RFC]: Support Serverless Code Interpreter Open

enhancement rfc

vllm-project/agentic-api#308 · 1 comment · 2 reactions · 1 assignee · Opened Sep 15, 2026
match OpenAI multi-agent WebSocket injection and record transport conformance Open

enhancement

vllm-project/agentic-api#300 · 1 assignee · Opened Sep 14, 2026
implement OpenAI-compatible multi-agent Responses in the gateway over HTTP Open

enhancement

vllm-project/agentic-api#299 · 1 assignee · Opened Sep 14, 2026
support Responses multi-agent orchestration over HTTP and WebSocket Open

enhancement

vllm-project/agentic-api#298 · 1 assignee · Opened Sep 14, 2026
[RFC] Pluggable Web Search Providers and Typed Result Normalization Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

vllm-project/agentic-api#291 · 1 comment · Opened Sep 12, 2026
feat: add OpenTelemetry traces and metrics Open

vllm-project/agentic-api#279 · 1 comment · 1 assignee · Opened Sep 11, 2026
Support Codex CLI image attachments with vLLM Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

vllm-project/agentic-api#251 · Opened Sep 6, 2026
perf: benchmark inline versus worker placement for streaming ingestion Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

vllm-project/agentic-api#245 · 1 comment · Opened Sep 4, 2026
refactor: extract StreamRelay and bound client delivery Open

vllm-project/agentic-api#244 · 4 comments · 1 assignee · Opened Sep 4, 2026
[RFC]: one linear ingest pipeline for the executor streaming path Open

enhancement rfc

Difficulty 5/5 Over a week Newbie friendliness 35/100

vllm-project/agentic-api#241 · 1 comment · Opened Sep 4, 2026
Add SGLang and NVIDIA Dynamo provider-conformance recordings Open

vllm-project/agentic-api#211 · 1 assignee · Opened Aug 27, 2026
Add OpenAI-compatible computer use tool support Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 28/100

vllm-project/agentic-api#171 · 1 comment · Opened Aug 7, 2026
Make Agentic API the execution owner for typed Responses tools Open

vllm-project/agentic-api#160 · 1 assignee · Opened Jul 31, 2026
[Claude Code - Stage 4] Normalize Messages session identity for cache-aware routing Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

vllm-project/agentic-api#159 · Opened Jul 31, 2026
Complete the OpenAI-compatible Conversations API Open

enhancement enterprise-readiness

vllm-project/agentic-api#155 · 5 comments · 1 assignee · Opened Jul 31, 2026
Support Approval path for MCP tools. Open

enhancement enterprise-readiness

Difficulty 5/5 Over a week Newbie friendliness 30/100

vllm-project/agentic-api#145 · Opened Jul 24, 2026
Add deployment, authentication, and persistence end-to-end verification Open

enhancement enterprise-readiness

Difficulty 5/5 Over a week Newbie friendliness 25/100

vllm-project/agentic-api#110 · Opened Jul 14, 2026
Add Render deployment configuration and documentation Open

vllm-project/agentic-api#109 · 1 assignee · Opened Jul 14, 2026
Enforce user and tenant ownership for persisted state Open

enhancement enterprise-readiness

Difficulty 5/5 Over a week Newbie friendliness 25/100

vllm-project/agentic-api#107 · Opened Jul 14, 2026
Deploy agentic-api as a remotely persistent, authenticated service Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

vllm-project/agentic-api#102 · Opened Jul 14, 2026
Benchmark KV-affine Responses routing and token artifacts Open

vllm-project/agentic-api#74 · 1 assignee · Opened Jun 19, 2026
Add portable vLLM token artifacts for Responses continuations Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

vllm-project/agentic-api#70 · Opened Jun 19, 2026
Persist reliable Responses continuation checkpoints Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

vllm-project/agentic-api#71 · Opened Jun 19, 2026
Upstream exact Responses prefix routing through llm-d Open

vllm-project/agentic-api#73 · 1 assignee · Opened Jun 19, 2026
Maximize KV-cache reuse for agentic Responses workloads Open

vllm-project/agentic-api#69 · 1 assignee · Opened Jun 19, 2026
RFC: Session-aware KV cache management Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

vllm-project/agentic-api#18 · 2 comments · 1 reaction · Opened Apr 2, 2026

vllm-project/agentic-api

Get new issues in your inbox