NVIDIA / NVIDIA/nvcf

feat(llm-routing): support routing expressions in CLI inline model forms

Open
#1,408 0 comments 0 reactions 1 assignee View on GitHub

@along-2017 is already working on this.

Since Sep 3, 2026.

Dominant language
Go
Stars
218
Forks
72
Avg merge
1d 12h
Merged PRs (30d)
427

Description

Description

Part of #536 (per-model routing configuration).

Support routing expressions in the CLI's inline model forms. Commas remain the
inline field separators; semicolons carry expression parameters inside the
routing method field. Validate the same format-only profile as the API,
normalize the algorithm token to canonical spelling, and accept every
router-supported method. JSON file input accepts the same expressions.

Definition of Done

  • Both inline model forms accept expressions with parameters
  • No router-supported method is rejected; input spelling variants are
    normalized to canonical
  • Malformed expressions fail with a precise error before any API call
  • Table-driven tests cover the grammar profile and the comma/semicolon
    interaction

Resources

  • Parent: #536
  • Blocked by: control plane accepts and persists routing expressions

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.