NVIDIA / NVIDIA/nvcf

feat(llm-routing): telemetry and audit for routing expressions

Open
#1,405 0 comments 0 reactions 1 assignee View on GitHub

@along-2017 is already working on this.

Since Sep 3, 2026.

Dominant language
Go
Stars
218
Forks
72
Avg merge
1d 12h
Merged PRs (30d)
427

Description

Description

Part of #536 (per-model routing configuration).

Audit and observe routing expressions. After the router successfully parses an
expression, emit the full canonical form in structured logs and traces so every
request's effective routing configuration is auditable. Keep metric labels
bounded to method, outcome, and cache result; expression content and parameter
values must never become metric labels.

Definition of Done

  • Accepted expressions appear in canonical form in structured logs and
    traces
  • Rejections log the reason with the existing structured fields
  • Metric label sets are bounded to method, outcome, and cache result
  • Tests cover audit events and label boundedness

Resources

  • Parent: #536
  • Blocked by: router expression parsing and overlay

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.