NVIDIA / NVIDIA/Personal-AI-Router
[Feature]: Third-party hosts driving nvpair-ui-broker: is the JSON-RPC surface a supported contract, is the app-data layout versioned, and can the proxy expose the serving node?
Nadie ha tomado este issue todavía.
- Lenguaje dominante
- Go
- Estrellas
- 1.4k
- Forks
- 250
- Merge medio
- 23 h 27 min
- PR fusionados (30 d)
- 1
Descripción
Area
nvpair-ui-broker (JSON-RPC surface, --ipc mode), nvpair-cluster-manager (app-data / cluster dir layout), ollama-proxy (response headers)
User problem
We are integrating PAIR as the LAN inference layer behind our own desktop application (Magieva Desktop, an Electron app; we are an NVIDIA Inception member). Our host process supervises nvpair-ui-broker itself — spawned with piped stdio, or over --ipc — instead of the shipped PAIR UI, and relies on:
discovery:get-nodes/discovery:subscribe→discovery:nodes-changedfor the roster (members, addresses,modelsByEngine,loadedByEngine,trusted/clustered);workloads:subscribe→workloads:upsertwithworkloadInfo.scheduledOn/originatedFromto record which node actually served each request (we write it to our usage ledger);cluster:invite-node/cluster:respond-to-invite/cluster:invite-statusandengine:remote-install/engine:remote-pull-modelto drive pairing and model placement from our own UI;- the per-user app-data directory (
~/Library/Application Support/Nvidia Corporation/Personal AI Routeron macOS) and the cluster dir (identity.json,node.crt,node.key,trusted/) so an existing NVIDIA-created node keeps its identity when our host takes over supervision.
Measured on v0.1.1 (13b6811, built from source with Go 1.25, macOS 26 / Apple M4 Max): all of the above works today when the broker is driven from a plain shell over newline-delimited JSON-RPC 2.0 — app:ready in ~3 s, the roster is pushed, a real Ollama turn through the proxy yields workloads:upsert with scheduledOn set, and the invite / engine methods are routed. What we cannot determine from the repo:
- Is the broker's JSON-RPC method + notification surface a supported integration contract, with a compatibility policy across releases (additive changes only? deprecation window?), or is it considered internal to the shipped UI?
- Is the on-disk format of the app-data and cluster directories versioned?
node-id.jsonandcluster/identity.jsoncarry onlynode_uuidandcreated_at;services/VERSIONING.mdversions binaries, not the data layout. A third-party host cannot tell whether a directory written by a newer or older PAIR is safe to attach to, or refuse it cleanly. - Will the proxies expose the serving node on the HTTP response (e.g. an
X-PAIR-Served-On: <hostUuid>header)? Today it is available only through the broker event stream (proxy:proxy/request.node_id,workloads:upsert.scheduledOn), which is fine for a host that also owns the broker, but not for an Ollama-compatible client that only sees the proxy.
Desired outcome
- A short statement in the broker README (or a
docs/integration.mdx) of which methods/notifications are stable for third-party hosts and how breaking changes are announced. - A
format_version(or equivalent) field innode-id.json/cluster/identity.json, plus a documented rule for what a host should do when it does not match. - Optionally, a
X-PAIR-Served-Onresponse header onollama-proxy/lmstudio-proxyresponses.
Alternatives considered
- Pinning to a vendored
v0.1.1build and treating every upgrade as a full re-validation of the JSON-RPC surface (what we will do if the surface is declared internal). - Reading the serving node only from the broker events (works for us; leaves plain Ollama clients unable to attribute a response).
- Inferring the data-dir version from file shape (fragile; the reason for question 2).
Compatibility and security implications
Additive only: a version field and a response header change no existing behaviour. A published compatibility policy lets hosts fail closed on a surface they do not recognise instead of guessing. No change to pairing, mTLS or data handling is requested.
Validation approach
- Drive the broker from a shell exactly as we did:
./nvpair-ui-broker --cluster-dir <dir>from a directory holding the sibling binaries, send{"jsonrpc":"2.0","id":1,"method":"discovery:subscribe"}andworkloads:subscribe, run onePOST /api/chatthrough the proxy, observeworkloads:upsertwithscheduledOn. - For the version field: create a node, read
node-id.json, confirm the field; start a host against a directory carrying a higher version and confirm it refuses with a clear error. - For the header:
curl -ia successfulPOST /api/chatthrough the proxy and read the header.
Confirmations
- I searched existing issues for duplicates (#1, #4, #48, #49, #58 are adjacent — mDNS reflectors, enrichment refresh, test data dir, Linux service, headless manual nodes — none asks about contract stability, data-dir versioning or a served-on header).
- I agree to follow the Code of Conduct.
Guía de contribución
Primeros pasos
- Lee el issue completo y luego la guía de contribución del proyecto.
- Comenta en el issue que vas a ocuparte — evita que dos personas hagan lo mismo.
- Haz un fork del repositorio y trabaja en una rama.
- Abre un pull request que haga referencia al número del issue.
Línea de trabajo
Comienza con el punto de entrada JSON-RPC de nvpair-ui-broker y README o docs/integration.mdx; después, inspecciona services/VERSIONING.md, node-id.json y cluster/identity.json. Reproduce los comandos documentados del broker y del proxy, incluidos discovery:subscribe, workloads:subscribe y curl, para establecer el comportamiento actual. La tarea estará terminada cuando el contrato compatible, el manejo de formatos de datos y cualquier metadato de respuesta del proxy estén documentados o implementados con la validación indicada.
Escrito por el modelo de indexación a partir del texto del issue.
Evaluación
- Stack tecnológico
- electron, go, ollama
- Área
- api, backend, distributed-systems
- Tipo de issue
- Nueva funcionalidad
- Dificultad
- 5/5
- Tiempo estimado
- Más de una semana
- Estado de actividad
- Activo
- Claridad
- Bastante claro
- Aptitud para principiantes
- 38/100