microsoft / microsoft/mcp

[BUG] Sampling requests for tool selection should specify a low-cost LLM

Open
#873 1 comment 0 reactions 1 assignee Assigned to @LarryOsterman View on GitHub
bug server-Azure.Mcp tools-Core
Dominant language
C#
Stars
3.7k
Forks
624
Avg merge
2d 20h
Merged PRs (30d)
220

Description

### Describe the bug

In namespace mode, sampling is used to map the user's intent to one of a set of base tools. The MCP protocol allows sampling requests to specify preferences for the language model to use but we currently leave this blank; we'll end up with whatever model is the default determined by the client. It is possible this goes to an expensive model (consuming the user's tokens/time) when a lower cost or free model would work just as well.

### Expected behavior

When used for tool selection, sampling requests should specify free ("0x") or low-cost models.

### Actual behavior

Sampling requests do not specify any preferred LLM models.

### Reproduction Steps

Run Azure MCP in the default (namespace) mode and run a prompt that will invoke sampling.

### Environment

_No response_

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.