lmstudio-ai / lmstudio-ai/mlx-engine

LoRA support

Open
#51 12 comments 0 reactions 0 assignees View on GitHub
enhancement
Dominant language
Python
Stars
1.2k
Forks
133
Avg merge
21h 6m
Merged PRs (30d)
1

Description

Hi,

I use MLX to create LoRA adapters in .safetensors format.

MLX LM has a web server that can take the name/path of the LoRA adapter at inference time when using the Chat completion endpoint by specifying the adapter parameter in the JSON payload.

Would be great to see the same being supported on LM Studio

Contributor guide

Open the contributing guide

Research direction

Start by locating the MLX engine's web server and Chat completion endpoint, then compare its request handling with MLX LM's LoRA adapter parameter. The issue describes .safetensors adapters and an adapter name/path in the JSON payload; done means LM Studio accepts and uses that adapter during inference.

Written by the indexing model from the issue text.

Assessment

Tech stack
python
Domain
api, machine-learning
Issue type
Feature
Difficulty
4/5
Estimated time
3-5 days
Activity status
Active
Clarity
Mostly clear
Newbie friendliness
48/100

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.