Model contradicts its own runtime behavior — claims no HTTP MCP support while actively using it
- 主要語言
- Shell
- 星號
- 11.2k
- 分支
- 1.9k
- 平均合併
- 14 小時 16 分鐘
- 30 天內合併 PR
- 6
描述
### Describe the bug
The model (Claude Opus 4.6 via Copilot CLI v1.0.41) makes 50+ successful native HTTP MCP tool calls during a session, then when asked to create a comparison table of AI clients, incorrectly classifies its own runtime as "❌ does not support HTTP MCP — needs stdio proxy". This directly contradicts what it is doing in the same session.
### Affected version
1.0.41
### Steps to reproduce the behavior
1. Connect Claude Opus 4.6 to an MCP server via HTTP transport (Streamable HTTP)
2. Successfully use MCP tools (li_h, qu_i, fuz_s, etc.) — model calls them natively throughout the session
3. Ask the model to create a comparison table of AI clients and their MCP transport support
4. Model classifies its own runtime (Copilot CLI) as "❌ stdio only — needs proxy" despite actively using HTTP MCP tools in the same conversation
Actual Result: Model outputs Copilot CLI (мы) | ❌ | — | — | ✅ Через stdio-proxy — claiming it does NOT support HTTP transport and requires a proxy, while simultaneously using HTTP transport without a proxy.
Impact: Provides incorrect technical guidance to the user. User had to manually correct the model. This is a self-contradiction — the model's declarative knowledge conflicts with its procedural behavior in the same context window.
### Expected behavior
_No response_
### Additional context
Additional Context:
- Sub agents in the session were called and used the proxy to be able to call the mcp tools natively! Looks like this was impact the table.
- The model had made 50+ successful native HTTP MCP tool calls in the same session before producing the incorrect table
- When confronted, the model immediately acknowledged the error and corrected it
- This suggests the model relies on stale training data about "Copilot CLI capabilities" rather than introspecting its actual runtime environment
貢獻指南
研究方向
Start by reproducing the reported flow in Copilot CLI v1.0.41: connect an HTTP MCP server, make several tool calls, and request the comparison table. Compare the model's classification with the active transport and the sub-agent proxy behavior; done requires a defined runtime-aware behavior or an agreed explanation of the limitation.
由索引模型根據 Issue 內容生成。
評估
- 領域
- ai, cli
- Issue 類型
- 缺陷
- 難度
- 5/5
- 預估耗時
- 一週以上
- 活躍度
- 冷清
- 描述清晰度
- 需要釐清
- 新手友好度
- 30/100