kserve / kserve/website

docs: document dual-protocol (REST/gRPC) routing for Standard mode

Open Beginner friendly
#729 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
MDX
Stars
113
Forks
193
Avg merge
5d 20h
Merged PRs (30d)
3

Description

## Summary

KServe v0.19 added dual-protocol (REST + gRPC) routing support for InferenceService Standard mode when using the Gateway API. No documentation exists for this feature.

## What needs to be documented

- How the HTTPRoute reconciler detects REST and gRPC ports from the backing Service
- gRPC detection: based on `appProtocol = kubernetes.io/h2c` and/or port name heuristics (containing grpc/h2c)
- Two HTTPRoute rules generated: gRPC match first (`application/grpc.*` content-type header), REST/HTTP fallback second
- Both protocols served behind the same hostname
- Why separate GRPCRoute + HTTPRoute for the same host doesn't work (Gateway API constraint)
- Example configuration showing a Service with both REST and gRPC ports

## Related PR

- https://github.com/kserve/kserve/pull/5451

## Since

KServe v0.19

Contributor guide

No contributing guide indexed for this repository

Research direction

Start with related PR #5451 and the website’s existing Gateway API documentation. Document REST and gRPC port detection, the ordered HTTPRoute matches, the shared-hostname constraint, and a Service example with both ports. Done means a newcomer can understand and configure dual-protocol routing in Standard mode.

Written by the indexing model from the issue text.

Assessment

Tech stack
kubernetes
Domain
documentation
Issue type
Documentation
Difficulty
2/5
Estimated time
1-3 hours
Activity status
Quiet
Clarity
Clearly specified
Newbie friendliness
76/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.