NVIDIA/nvcf

View on GitHub

Platform for deploying and routing GPU-accelerated inference, streaming, and batch workloads at scale.

Stars: 218
Forks: 72
Open beginner issues: 0
Indexed issues: 326
Avg merge: 1d 12h
Merged PRs (30d): 427

Dominant language: Go
License: Apache-2.0
Last GitHub push: Sep 19, 2026
Latest indexed: Sep 19, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: good first issue

Beginner friendly Everything

Open All

326 open issues indexed

Self-managed Pylon discovery bypasses enabled backend routing Open

needs-triage

NVIDIA/nvcf#1990 · 1 assignee · Opened Sep 19, 2026
nvcf-compute-plane stack pin never auto-bumps with the collector it deploys Open

ci

NVIDIA/nvcf#1986 · 1 assignee · Opened Sep 18, 2026
release: encode the service dependency graph as helmfile needs: edges Open

ci

NVIDIA/nvcf#1982 · 1 assignee · Opened Sep 18, 2026
release: helmfile layer batching makes needs: edges unsafe to add Open

ci

NVIDIA/nvcf#1981 · 1 assignee · Opened Sep 18, 2026
docs: customer-facing upgrade guide Open

ci

NVIDIA/nvcf#1980 · 1 assignee · Opened Sep 18, 2026
release: charts declare the migrations they require Open

ci

NVIDIA/nvcf#1979 · 1 assignee · Opened Sep 18, 2026
release: migration tasks report their own completion status Open

ci

NVIDIA/nvcf#1978 · 1 assignee · Opened Sep 18, 2026
release: in-cluster upgrade receipt and pre-upgrade validation hook Open

ci

NVIDIA/nvcf#1977 · 1 assignee · Opened Sep 18, 2026
release: stack bundles do not pin the cassandra-migrations image version Open

ci

NVIDIA/nvcf#1976 · 1 assignee · Opened Sep 18, 2026
release: CI check validating stack version bumps against migration evidence Open

ci

NVIDIA/nvcf#1975 · 1 assignee · Opened Sep 18, 2026
release: tooling for safe self-managed stack upgrades Open

ci

NVIDIA/nvcf#1974 · 1 assignee · Opened Sep 18, 2026
event-ledger returns 403 instead of 401 for requests with no Authorization header Open

Difficulty 2/5 1-3 hours Newbie friendliness 86/100

NVIDIA/nvcf#1967 · Opened Sep 18, 2026
Add a diagnostics utility to validate NVCF deployment prerequisites and collect environment details Open

needs-triage

Difficulty 5/5 Over a week Newbie friendliness 25/100

NVIDIA/nvcf#1966 · Opened Sep 18, 2026
nvca: MiniService re-renders chart via ReVal after install and fails running instances on invalid render Open

needs-triage

Difficulty 4/5 3-5 days Newbie friendliness 35/100

NVIDIA/nvcf#1956 · Opened Sep 17, 2026
Evaluate integrating NVCRE into nvca cluster-validator for compute-plane GPU-fabric checks Open

NVIDIA/nvcf#1949 · 1 assignee · Opened Sep 17, 2026
feat(llm): propagate deployment request concurrency to Pylon Open

needs-triage

Difficulty 4/5 3-5 days Newbie friendliness 66/100

NVIDIA/nvcf#1946 · Opened Sep 16, 2026
Define and enforce retention for Event Ledger events Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

NVIDIA/nvcf#1943 · Opened Sep 16, 2026
nvca operator Agent.Start has no integration test coverage for its HTTP routes Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

NVIDIA/nvcf#1918 · Opened Sep 15, 2026
Support ordered fallbacks for sticky shadow sampling Open

needs-triage

NVIDIA/nvcf#1910 · 1 assignee · Opened Sep 15, 2026
Derive repeatable cache affinity from stable prompt prefixes Open

Difficulty 5/5 Over a week Newbie friendliness 45/100

NVIDIA/nvcf#1904 · Opened Sep 15, 2026
Wire NVCA otel-collector to event-ledger Open

NVIDIA/nvcf#1901 · 1 assignee · Opened Sep 15, 2026
security(self-managed): remediate Samba 1.0.5 catalog blockers Open

needs-triage

Difficulty 5/5 Over a week Newbie friendliness 25/100

NVIDIA/nvcf#1895 · Opened Sep 15, 2026
docs(self-managed): document NVCA Helm resource-limit enforcement during upgrades Open

NVIDIA/nvcf#1888 · 1 assignee · Opened Sep 15, 2026
feat(nvcf-cli): update allowedExtraKubernetesTypes on a registered cluster Open

Difficulty 4/5 3-5 days Newbie friendliness 45/100

NVIDIA/nvcf#1877 · Opened Sep 15, 2026
Add table-backed BDD step for Helm function creation Open

good-first-issue

Difficulty 4/5 3-5 days Newbie friendliness 58/100

NVIDIA/nvcf#1871 · 1 comment · 1 reaction · Opened Sep 14, 2026
Epic: Move BDD fixture constants into chart defaults and remove masked configuration Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

NVIDIA/nvcf#1868 · 9 comments · Opened Sep 14, 2026
Automate reviewable development docs sync PRs after stack releases Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

NVIDIA/nvcf#1845 · Opened Sep 13, 2026
release: reconcile Pulse images missing from stack inventories Open

needs-triage

Difficulty 4/5 3-5 days Newbie friendliness 48/100

NVIDIA/nvcf#1831 · Opened Sep 12, 2026
fix(stargate): address protocol, lifecycle, recovery, and benchmark audit findings Open

Difficulty 5/5 Over a week Newbie friendliness 15/100

NVIDIA/nvcf#1817 · Opened Sep 11, 2026
[QA] Test request: NVCA OTel Collector Extension for Event Ledger (#809) Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

NVIDIA/nvcf#1802 · Opened Sep 11, 2026
release: align remaining self-managed image and chart pins Open

needs-triage

Difficulty 5/5 Over a week Newbie friendliness 28/100

NVIDIA/nvcf#1781 · 2 comments · Opened Sep 11, 2026
chart-version-bump and stack-pin-bump silently drop queued runs on simultaneous releases Open

Difficulty 4/5 3-5 days Newbie friendliness 68/100

NVIDIA/nvcf#1762 · Opened Sep 10, 2026
Document the self-managed 0.6.1 to 0.14.4 upgrade Open

Difficulty 4/5 3-5 days Newbie friendliness 55/100

NVIDIA/nvcf#1757 · Opened Sep 10, 2026
Refresh OpenSSL packages in the Unbound image Open

NVIDIA/nvcf#1736 · 1 assignee · Opened Sep 10, 2026
Align function autoscaling scope with per-GPU-spec policies Open

needs-triage

Difficulty 5/5 Over a week Newbie friendliness 35/100

NVIDIA/nvcf#1717 · Opened Sep 10, 2026
Replace JWT plugin catalog refresh hook with versioned OpenBao plugin lifecycle Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

NVIDIA/nvcf#1713 · Opened Sep 10, 2026
vanity-gateway: tooManyRequestsMessage is dropped on the LLM Gateway path Open

Difficulty 2/5 1-3 hours Newbie friendliness 68/100

NVIDIA/nvcf#1690 · Opened Sep 9, 2026
Decide NVCT registry credential secret caching strategy Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

NVIDIA/nvcf#1662 · Opened Sep 8, 2026
Improve WaitAndWiden affinity fallback behavior Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

NVIDIA/nvcf#1659 · Opened Sep 8, 2026
Add support for event-ledger in SIS Open

NVIDIA/nvcf#1656 · 1 assignee · Opened Sep 8, 2026
Add PSAT authentication in event-ledger for NVCA otel collector Open

NVIDIA/nvcf#1655 · 1 assignee · Opened Sep 8, 2026
Discount cached prefill cost in WaitAndWiden routing Open

Difficulty 4/5 3-5 days Newbie friendliness 55/100

NVIDIA/nvcf#1639 · Opened Sep 8, 2026
feat(stargate): expose control API for config and routing state Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

NVIDIA/nvcf#1638 · Opened Sep 8, 2026
Harden OpenBao in-cluster traffic with TLS Open

Difficulty 5/5 Over a week Newbie friendliness 35/100

NVIDIA/nvcf#1630 · Opened Sep 8, 2026
Support user/session affinity routing from the OpenAI user field Open

Difficulty 4/5 3-5 days Newbie friendliness 55/100

NVIDIA/nvcf#1615 · Opened Sep 6, 2026
fix(function-autoscaler): re-evaluate metric source after first LLM request Open

needs-triage

Difficulty 4/5 3-5 days Newbie friendliness 55/100

NVIDIA/nvcf#1601 · Opened Sep 5, 2026
fix(invocation): tolerate rate-limiter startup during stack install Open

needs-triage

Difficulty 4/5 3-5 days Newbie friendliness 48/100

NVIDIA/nvcf#1596 · Opened Sep 5, 2026
fix(cassandra): make initialization wait for usable authentication Open

needs-triage

Difficulty 4/5 3-5 days Newbie friendliness 52/100

NVIDIA/nvcf#1595 · 1 comment · Opened Sep 5, 2026
fix(nvca): do not report a backend healthy before queue readiness Open

NVIDIA/nvcf#1590 · 1 assignee · Opened Sep 4, 2026
GET API to query NVCF function for token usage Open

needs-triage

Difficulty 5/5 Over a week Newbie friendliness 45/100

NVIDIA/nvcf#1582 · Opened Sep 4, 2026

NVIDIA/nvcf

Get new issues in your inbox