kserve / kserve/website

docs: document OpenAI Responses API and Anthropic Messages API routing

Open Beginner friendly
#723 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
MDX
Stars
113
Forks
193
Avg merge
5d 20h
Merged PRs (30d)
3

Description

## Summary

KServe added HTTPRoute rules for the **OpenAI Responses API** (`/v1/responses`) in v0.18 and the **Anthropic Messages API** (`/v1/messages`) in v0.20 for LLMInferenceService. Neither endpoint is documented.

## What needs to be documented

- `/v1/responses` endpoint routing through InferencePool (OpenAI Responses API)
- `/v1/messages` endpoint routing through InferencePool (Anthropic Messages API)
- Both follow the same HTTPRoute pattern as `/v1/chat/completions` and `/v1/completions`
- Model-based routing rules are automatically included for both endpoints
- Update any existing endpoint/API reference tables to include these endpoints

## Related PRs

- https://github.com/kserve/kserve/pull/5291 (OpenAI Responses API, v0.18)
- https://github.com/kserve/kserve/pull/5648 (Anthropic Messages API, v0.20)

## Since

KServe v0.18 (`/v1/responses`), v0.20 (`/v1/messages`)

Contributor guide

No contributing guide indexed for this repository

Research direction

Search the documentation for the existing HTTPRoute examples and endpoint/API reference tables covering /v1/chat/completions and /v1/completions. Follow that structure to document /v1/responses and /v1/messages, including model-based routing, and confirm both endpoints appear in the relevant references.

Written by the indexing model from the issue text.

Assessment

Domain
documentation
Issue type
Documentation
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Quiet
Clarity
Mostly clear
Newbie friendliness
74/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.