microsoft / microsoft/mcp

[CONSOLIDATED] `evaluate_azure_ai_foundry_agents` tool was not activated by test prompt

Open
#1,068 1 comment 0 reactions 1 assignee Assigned to @LarryOsterman View on GitHub
bug server-Azure.Mcp tools-Core
Dominant language
C#
Stars
3.7k
Forks
624
Avg merge
2d 20h
Merged PRs (30d)
220

Description

**Description:**
In `consolidated` mode, entering `Evaluate the full query and response I got from my agent for task_adherence` prompt did not trigger the MCP tool `evaluate_azure_ai_foundry_agents`, as shown below:
Image
Image

**Steps to Reproduce:**
1. Start mcp server in `consolidated` mode.
2. Open GitHub Copilot in VS Code and [switch to Agent mode](https://code.visualstudio.com/docs/copilot/chat/chat-agent-mode).
3. Click Refresh on the tools list, and select the `Built-in`, `Extension: Github Copilot for Azure`, `github MCP server` and `MCP Server: Azure MCP`.
4. Enter test prompts `Evaluate the full query and response I got from my agent for task_adherence`.

**Environment:**

- OS: Windows.
- Vscode Version: 1.105.1
- GitHub Copilot Chat Version: 0.32.4
- Large Language Model: **Claude Sonnet 4.5**
- Virtual Tool: On
- Azure MCP Server: **1.0.0**

**Expected Behavior:**
These prompts can successfully trigger the expected `evaluate_azure_ai_foundry_agents` tool.

@joshfree for notification

Contributor guide

Open the contributing guide

Assessment

This issue has not been assessed yet.

Get new issues in your inbox

A short digest of beginner-friendly GitHub issues.