NVIDIA-NeMo/Switchyard

View on GitHub

Switchyard lets LLM applications route traffic across models and providers while preserving native OpenAI and Anthropic API compatibility - enabling flexible model selection, benchmarking, and cost/performance optimization.

Stars: 3.2k
Forks: 291
Open beginner issues: 0
Indexed issues: 42
Avg merge: 1d 8h
Merged PRs (30d): 182

Dominant language: Rust
License: Apache-2.0
Last GitHub push: Sep 18, 2026
Latest indexed: Sep 19, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: No beginner labels indexed

Beginner friendly Everything

Open All

42 open issues indexed

Add an optional GLiNER classifier sidecar for custom routing Open

Difficulty 5/5 Over a week Newbie friendliness 38/100

NVIDIA-NeMo/Switchyard#735 · 1 comment · Opened Sep 17, 2026
feat(routing): add a TypeSafe-backed classifier router Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

NVIDIA-NeMo/Switchyard#723 · 8 comments · 1 reaction · Opened Sep 16, 2026
bug(translation): normalized Chat replay loses reasoning field spelling Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

NVIDIA-NeMo/Switchyard#698 · Opened Sep 15, 2026
[feature] add a native Python host driver Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 48/100

NVIDIA-NeMo/Switchyard#683 · Opened Sep 11, 2026
feat(routing): add ensemble response synthesis Open

Difficulty 5/5 Over a week Newbie friendliness 20/100

NVIDIA-NeMo/Switchyard#682 · Opened Sep 11, 2026
ci: evaluate a main-owned Rust dependency cache Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 72/100

NVIDIA-NeMo/Switchyard#669 · Opened Sep 10, 2026
[feature] Serve intermediate judge calls in the LiteLLM routing plugin (classifier-backed routing) Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

NVIDIA-NeMo/Switchyard#665 · Opened Sep 10, 2026
[feature] Add optional de-escalation to the escalation router Open

Difficulty 4/5 3-5 days Newbie friendliness 64/100

NVIDIA-NeMo/Switchyard#661 · 1 comment · Opened Sep 10, 2026
[feature] Support native Gemini generateContent translation Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 68/100

NVIDIA-NeMo/Switchyard#642 · Opened Sep 8, 2026
[bug]: --dry-run accepts configured HTTP headers that cannot be sent Open

Difficulty 3/5 1-2 days Newbie friendliness 68/100

NVIDIA-NeMo/Switchyard#626 · Opened Sep 4, 2026
[bug] OpenAI-to-Anthropic translation erases structured refusal text and emits empty text block Open

Difficulty 3/5 1-2 days Newbie friendliness 72/100

NVIDIA-NeMo/Switchyard#622 · 2 comments · Opened Sep 4, 2026
[bug] Keep upstream error content out of logs and traces Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 45/100

NVIDIA-NeMo/Switchyard#615 · Opened Sep 3, 2026
[feature] Surface lossy translation diagnostics at runtime Open

Difficulty 4/5 3-5 days Newbie friendliness 55/100

NVIDIA-NeMo/Switchyard#607 · Opened Sep 3, 2026
[Research] Evaluate GZip-kNN for request routing Open

Difficulty 5/5 Over a week Newbie friendliness 30/100

NVIDIA-NeMo/Switchyard#603 · 1 comment · Opened Sep 2, 2026
[Proposal] Unified routing surface Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

NVIDIA-NeMo/Switchyard#601 · 3 reactions · Opened Sep 2, 2026
Judge requests forward image content blocks verbatim, so a text-only judge fails every attached request open to the capable tier Open

Difficulty 4/5 3-5 days Newbie friendliness 54/100

NVIDIA-NeMo/Switchyard#598 · 1 comment · Opened Sep 2, 2026
Decide the default bind address for switchyard-server Open

question

Difficulty 5/5 Over a week Newbie friendliness 42/100

NVIDIA-NeMo/Switchyard#596 · 2 comments · Opened Sep 2, 2026
[feature] Skip repeatedly unavailable routing candidates with circuit breakers Open

NVIDIA-NeMo/Switchyard#594 · 1 comment · 1 assignee · Opened Sep 1, 2026
[feature] Decide where trusted request context should live Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

NVIDIA-NeMo/Switchyard#583 · 3 comments · Opened Aug 31, 2026
[feature] Add VGSR as a first-class routing algorithm Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

NVIDIA-NeMo/Switchyard#570 · 2 comments · Opened Aug 27, 2026
[bug] Responses codec emits adjacently-tagged ImageSource/FileSource into image_url/file Open

Difficulty 3/5 1-2 days Newbie friendliness 82/100

NVIDIA-NeMo/Switchyard#564 · 1 comment · Opened Aug 27, 2026
Add a reproducible NeMo Gym example for comparing routing strategies Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 55/100

NVIDIA-NeMo/Switchyard#559 · 2 comments · 2 reactions · Opened Aug 26, 2026
[feature] Stackable / Hierarchical routers Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 25/100

NVIDIA-NeMo/Switchyard#522 · 2 comments · Opened Aug 22, 2026
[bug] Reused OpenAI tool-call IDs break multi-turn Anthropic tool workflows Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 55/100

NVIDIA-NeMo/Switchyard#502 · 4 comments · Opened Aug 20, 2026
routing: make system prompts follow answer targets Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

NVIDIA-NeMo/Switchyard#496 · Opened Aug 20, 2026
docs/feat(libsy): classify_trigger = "user_turn" needs a session id, and cannot fall back to a message hash Open

Difficulty 4/5 3-5 days Newbie friendliness 62/100

NVIDIA-NeMo/Switchyard#495 · 1 comment · Opened Aug 20, 2026
[feature] Support sub-agent-aware model routing Open

enhancement

Difficulty 5/5 Over a week Newbie friendliness 35/100

NVIDIA-NeMo/Switchyard#493 · Opened Aug 20, 2026
Responses backend rejects plaintext reasoning after cross-provider routing Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

NVIDIA-NeMo/Switchyard#481 · 1 comment · Opened Aug 19, 2026
Neutral IR does not record structured-output enforcement Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

NVIDIA-NeMo/Switchyard#467 · Opened Aug 18, 2026
[feature] Define JSON Object contracts for custom classifiers Open

Difficulty 5/5 Over a week Newbie friendliness 45/100

NVIDIA-NeMo/Switchyard#429 · Opened Aug 14, 2026
Escalation/capability judges: calibration knobs for tool-step (agentic) responses Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

NVIDIA-NeMo/Switchyard#375 · 1 comment · Opened Aug 11, 2026
[Bug] A target's extra_body is applied to another target that shares its model id Open

Difficulty 4/5 3-5 days Newbie friendliness 72/100

NVIDIA-NeMo/Switchyard#354 · 5 comments · Opened Aug 11, 2026
feat(libsy): evict targets that reject a request as unservable Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

NVIDIA-NeMo/Switchyard#345 · 2 comments · Opened Aug 11, 2026
Session affinity keys on an empty session id, and is silent when it cannot key at all Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

NVIDIA-NeMo/Switchyard#301 · 1 comment · Opened Aug 5, 2026
Emit physical provider and classifier attempt lifecycles through Relay Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

NVIDIA-NeMo/Switchyard#299 · 2 comments · Opened Aug 5, 2026
fix(libsy): cap the windowed judge payload and restate the routing instruction last Open

Difficulty 4/5 3-5 days Newbie friendliness 68/100

NVIDIA-NeMo/Switchyard#279 · 1 comment · Opened Aug 4, 2026
feat: bound how long a routed request may take Open

Difficulty 5/5 Over a week Newbie friendliness 38/100

NVIDIA-NeMo/Switchyard#277 · 1 comment · Opened Aug 4, 2026
[Bug] stage_router: capable_first can't offload at the default confidence_threshold=0.5 Open

Difficulty 4/5 3-5 days Newbie friendliness 55/100

NVIDIA-NeMo/Switchyard#264 · 3 comments · Opened Aug 3, 2026
feat(libsy-llm-client): report rejected extra_body keys as a configuration error Open

Difficulty 3/5 1-2 days Newbie friendliness 74/100

NVIDIA-NeMo/Switchyard#260 · 2 comments · Opened Aug 3, 2026
[Feature] Separate the user's question from the context Claude Code injects around it Open

Difficulty 3/5 1-2 days Newbie friendliness 76/100

NVIDIA-NeMo/Switchyard#252 · 3 comments · Opened Aug 3, 2026
[Bug] Claude Code requests fail on Azure Opus when thinking parameters are not normalized per target Open

Difficulty 4/5 3-5 days Newbie friendliness 68/100

NVIDIA-NeMo/Switchyard#239 · 2 comments · Opened Aug 2, 2026
[bug] Filter unsupported input modalities per target Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

NVIDIA-NeMo/Switchyard#152 · 3 comments · Opened Jul 27, 2026

NVIDIA-NeMo/Switchyard

Get new issues in your inbox