jlevy / jlevy/kash

Support for LM Studio?

Open
#2 0 comments 0 reactions 0 assignees View on GitHub
Dominant language
Python
Stars
26
Forks
5
Avg merge
3h 55m
Merged PRs (30d)
7

Description

Hi @jlevy ,

pretty cool work, thanks a lot! This already pretty amazing. I had a look at warp, opencode-ai (the original one) and crush before and while they are pretty amazing as well, to me they feel too encapsulated.

I am missing a feature to use self-hosted LLMs, though. From what I can tell from the code, this is currently not supported, I did not over look something. I started to experiment on a [fork](https://github.com/jlevy/kash/compare/main...GiugAles:kash:feat/lmstudio) and it seems, that by leveraging litellm, that you already use, it is almost there. For now, I will proceed with my "proof of concept" but I am curious if you would consider integrating such a feature.

Configuration would look as follows:

```
LM_STUDIO_MODEL="my-remote-model"
LM_STUDIO_API_KEY="sk-1234"
# This is where litellm proxy is running. Alternative, LM Studio without litellm is also working.
LM_STUDIO_API_BASE="http://:4000/v1"

```

Kind regards,
Alessandro

Contributor guide

No contributing guide indexed for this repository

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.