microsoft / microsoft/vscode

Expose contextSizeOptions for BYOK models

Open
#329,892 0 comments 3 reactions 1 assignee Claimed by @vritant24 View on GitHub
Dominant language
TypeScript
Stars
193k
Forks
42.4k
PR merge metrics
PR metrics pending

Description

Built-in Copilot models support a configurable context size in the thinking effort selector.
BYOK models do not - the only workaround is to create separate BYOK model definitions with differing contextWindow size options - and care must be taken when duplicating model IDs.
Feature request is to add a `contextSizeOptions` parameter or similar to the BYOKModelCapabilities interface used in chatLanguageModels.json to allow using the built-in selector instead.

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.