NVIDIA / NVIDIA/Personal-AI-Router
[Feature]: Persist per-model LM Studio load configuration when PAIR manages llmster
Nobody has claimed this yet.
- Dominant language
- Go
- Stars
- 1.4k
- Forks
- 250
- Avg merge
- 23h 27m
- Merged PRs (30d)
- 1
Description
Feature request
Please support persistent, per-node/per-model LM Studio load options when PAIR manages llmster.
Current behavior
The current LM Studio engine manifest loads a model with only:
lms load <model>
PAIR's UI supports downloading, loading, ejecting, and deleting models, but does not expose or persist important LM Studio load parameters.
Use case
Our existing GPU workstation requires deterministic settings such as:
lms load qwen/qwen3.6-35b-a3b --gpu max --context-length 200000 --parallel 2 --identifier qwen/qwen3.6-35b-a3b
These settings affect VRAM use, concurrency, context capacity, performance, and the stable model identifier used by existing applications. Falling back to LM Studio defaults after a PAIR or engine restart is not equivalent behavior.
Requested behavior
- Allow load options to be configured per model and per node.
- Persist those options across PAIR restarts, engine restarts, unload/reload operations, and machine reboots.
- Apply the saved configuration when PAIR automatically loads or restores a model.
- Display the effective load configuration and document which LM Studio options PAIR supports or intentionally ignores.
At minimum, support GPU offload, context length, parallelism, and a stable identifier. A generic advanced-arguments/configuration mechanism would also cover future lms load options.
Contributor guide
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Research direction
Start with the current LM Studio engine manifest and its lms load <model> entry point. Trace how PAIR handles model download, load, eject, delete, and automatic restore, then determine where per-node and per-model settings can persist. Done means supported load options survive the listed restart and reboot scenarios, are displayed effectively, and are documented.
Written by the indexing model from the issue text.
Assessment
- Tech stack
- go
- Domain
- backend
- Issue type
- Feature
- Difficulty
- 5/5
- Estimated time
- Over a week
- Activity status
- Active
- Clarity
- Mostly clear
- Newbie friendliness
- 45/100