microsoft / microsoft/foundry-dev-tools
Does not work with LMstudio or Jan.ai locally
@a1exwang is already working on this.
Since Sep 16, 2025.
- Dominant language
- JavaScript
- Stars
- 2.1k
- Forks
- 260
- Avg merge
- 42m
- Merged PRs (30d)
- 29
Description
Trying to run locally with LMstudio or Jan.ai
2025-09-15 14:19:13.126 [info] Loading View: modelPlayground
2025-09-15 14:19:18.807 [error] Failed to chatStream. model = "Custom/Qwen3-30B-A3B-Instruct-Coder-480B-Distill-v2-Q8_0.gguf", errorMessage = "Error: Unable to call the Qwen3-30B-A3B-Instruct-Coder-480B-Distill-v2-Q8_0.gguf inference endpoint due to 404. Please check if the input or configuration is correct.", errorType = "u", errorObject = {"innerError":{"status":404,"headers":{},"requestID":null}}
2025-09-15 14:19:18.807 [error] Unable to call the Qwen3-30B-A3B-Instruct-Coder-480B-Distill-v2-Q8_0.gguf inference endpoint due to 404. Please check if the input or configuration is correct. 404 Not Found
2025-09-15 14:20:03.404 [error] Failed to chatStream. model = "Custom/Qwen3-30B-A3B-Instruct-Coder-480B-Distill-v2-Q8_0.gguf", errorMessage = "Error: Unable to call the Qwen3-30B-A3B-Instruct-Coder-480B-Distill-v2-Q8_0.gguf inference endpoint due to 404. Please check if the input or configuration is correct.", errorType = "u", errorObject = {"innerError":{"status":404,"headers":{},"requestID":null}}
2025-09-15 14:20:03.405 [error] Unable to call the Qwen3-30B-A3B-Instruct-Coder-480B-Distill-v2-Q8_0.gguf inference endpoint due to 404. Please check if the input or configuration is correct. 404 Not Found
2025-09-15 14:20:26.870 [info] Information: Microsoft.Neutron.Telemetry.TelemetryLogger [0] 2025-09-15T14:20:26.8689352+03:00 UserAgent: Command:ListLoadedModels Status:Success Direct:True Time:0ms
Jan.ai config.
http://localhost:1337/v1
Qwen3-30B-A3B-Instruct-Coder-480B-Distill-v2-Q8_0.gguf
Qwen3-30B-A3B-Instruct-Coder-480B-Distill-v2-Q8_0.gguf
Apikey ***
LMstudio config.
http://192.168.1.130:1234
Qwen3-30B-A3B-Instruct-Coder-480B-Distill-v2-Q8_0
Qwen3-30B-A3B-Instruct-Coder-480B-Distill-v2-Q8_0
Apikey not set as LMstudio has no such key
Contributor guide
No contributing guide indexed for this repository
First steps
- Read the whole issue, then the project's contributing guide.
- Comment on the issue to say you are picking it up — it saves two people doing the same work.
- Fork the repository and make your change on a branch.
- Open a pull request that references the issue number.
Assessment
This issue has not been assessed yet.