anomalyco / anomalyco/opencode

[FEATURE]: Discover vLLM models out of the box on dev (port of #43022)

Open
#47,344 2 comments 1 reaction 1 assignee View on GitHub

@jlongster is already working on this.

Since Sep 4, 2026.

Dominant language
TypeScript
Stars
209k
Forks
27.5k
PR merge metrics
PR metrics pending

Description

Feature hasn't been suggested before.
  • I have verified this feature I'm about to request hasn't been suggested before.
Describe the enhancement you want to request

Pointing OpenCode at a vLLM server today means hand-writing a custom @ai-sdk/openai-compatible provider: model IDs, context limits, and for thinking models like Kimi K2 also "interleaved": "reasoning_content", otherwise the second turn fails with Assistant message is missing a thinking field. Provide one of: think, reasoning, reasoning_content, ....

The v2 branch already discovers vLLM models automatically (#43022, #43589), but none of that is in the current dev releases (1.18.x).

Proposal: a built-in vllm provider plugin on dev that reads /v1/models, uses max_model_len as the context limit, defaults reasoning_content interleaving, and takes the endpoint from VLLM_BASE_URL or provider.vllm.options.baseURL (optional API key). Zero config for a local server on 127.0.0.1:8000, one env var for a remote GPU box.

Contributor guide

Open the contributing guide

First steps

  1. Read the whole issue, then the project's contributing guide.
  2. Comment on the issue to say you are picking it up — it saves two people doing the same work.
  3. Fork the repository and make your change on a branch.
  4. Open a pull request that references the issue number.

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.