modelcontextprotocol

modelcontextprotocol/conformance

Conformance Tests for MCP

Stars: 127
Forks: 101
Open beginner issues: 0
Indexed issues: 54
Avg merge: 6d 1h
Merged PRs (30d): 7

Dominant language: TypeScript
License: No license data
Last GitHub push: Sep 11, 2026
Latest indexed: Sep 20, 2026
Contributing guide: Contributing guide
Code of conduct: Code of conduct
Beginner labels: No beginner labels indexed

Beginner friendly Everything

Open All

54 open issues indexed

Everything-server rejects valid _meta on stateful initialize Open

Difficulty 3/5 1-2 days Newbie friendliness 76/100

modelcontextprotocol/conformance#506 · Opened Sep 18, 2026
request-state-complete accepts tool-error results and completions missing its documented state-ok marker Open

Difficulty 3/5 1-2 days Newbie friendliness 76/100

modelcontextprotocol/conformance#505 · 1 comment · Opened Sep 15, 2026
Bound client-suite concurrency for timing-sensitive SSE checks Open

Difficulty 4/5 3-5 days Newbie friendliness 55/100

modelcontextprotocol/conformance#500 · Opened Sep 9, 2026
Standardised test reporting Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 50/100

modelcontextprotocol/conformance#486 · 1 comment · Opened Sep 3, 2026
tasks-lifecycle accepts completed status from its cancellable fixture Open

Difficulty 2/5 1-3 hours Newbie friendliness 35/100

modelcontextprotocol/conformance#485 · Opened Sep 3, 2026
feat(tier-check): support configurable label taxonomy and aliases for Tier 1 repo checks Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 55/100

modelcontextprotocol/conformance#482 · Opened Sep 1, 2026
Add server conformance for SEP-2350 scope challenges Open

Difficulty 4/5 3-5 days Newbie friendliness 68/100

modelcontextprotocol/conformance#480 · Opened Aug 31, 2026
sep-2322 absent-resultType probe is an invalid stimulus on the 2026-07-28 wire it negotiates Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

modelcontextprotocol/conformance#475 · 1 comment · Opened Aug 30, 2026
Add initial conformance tests for Resource AS of EMA Open

enhancement

modelcontextprotocol/conformance#470 · 1 comment · 1 reaction · 1 assignee · Opened Aug 28, 2026
Shift config of "known-sdks.ts" to SDK-side config file Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 48/100

modelcontextprotocol/conformance#460 · Opened Aug 17, 2026
tier-check spec-tracking does not detect SDK releases published shortly before the spec release Open

Difficulty 3/5 1-2 days Newbie friendliness 70/100

modelcontextprotocol/conformance#459 · Opened Aug 17, 2026
feat: Allow fixed request headers in server conformance tests Open

Difficulty 4/5 3-5 days Newbie friendliness 55/100

modelcontextprotocol/conformance#453 · 2 comments · Opened Aug 13, 2026
Expose expected-vs-emitted check coverage per scenario Open

Difficulty 5/5 Over a week Newbie friendliness 48/100

modelcontextprotocol/conformance#451 · 2 comments · Opened Aug 10, 2026
SEP-2243: safe-integer-range MUST is untested, and SDKs disagree on what it requires Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

modelcontextprotocol/conformance#445 · 1 comment · Opened Aug 5, 2026
tier-audit docs coverage: evaluate the feature list against the spec revision an SDK targets Open

Difficulty 3/5 1-2 days Newbie friendliness 72/100

modelcontextprotocol/conformance#441 · 1 comment · Opened Aug 4, 2026
input-required-result: harness sends the literal string `"undefined"` as an inputResponses key when round 1 names no input requests Open

Difficulty 3/5 1-2 days Newbie friendliness 76/100

modelcontextprotocol/conformance#440 · Opened Aug 4, 2026
input-required-result: sampling/roots scenarios vs SEP-2577, and capability-check accepting no inputRequests Open

Difficulty 3/5 1-2 days Newbie friendliness 58/100

modelcontextprotocol/conformance#439 · 1 comment · Opened Aug 3, 2026
Cover CIMD-only client authorization with no DCR endpoint Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 58/100

modelcontextprotocol/conformance#437 · 1 comment · Opened Aug 2, 2026
Add conformance scenario: logging/setLevel and log notifications Open

Difficulty 3/5 1-2 days Newbie friendliness 67/100

modelcontextprotocol/conformance#435 · 3 comments · Opened Aug 2, 2026
Add conformance scenario: progress notification edge cases Open

Difficulty 3/5 1-2 days Newbie friendliness 70/100

modelcontextprotocol/conformance#434 · Opened Aug 2, 2026
Add conformance scenario: notifications/cancelled Open

Difficulty 3/5 1-2 days Newbie friendliness 68/100

modelcontextprotocol/conformance#433 · Opened Aug 2, 2026
WIP: generic scenario steering — plumbing-only client scenarios shouldn't need per-SDK fixture handlers Open

Difficulty 5/5 Over a week Newbie friendliness 25/100

modelcontextprotocol/conformance#431 · Opened Jul 31, 2026
WARNING severity is inconsistent between client and server runners (client warnings can block Tier 1, server warnings cannot) Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

modelcontextprotocol/conformance#430 · 1 comment · Opened Jul 31, 2026
Spec gap: no defined success response for session-termination DELETE (only 405 is specified) Open

Difficulty 5/5 Over a week Newbie friendliness 30/100

modelcontextprotocol/conformance#429 · Opened Jul 31, 2026
tier-check: final 2026-07-28 is still treated as draft and legacy scenarios score by default Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

modelcontextprotocol/conformance#426 · 1 comment · Opened Jul 31, 2026
Wire-schema validation does not see raw-HTTP / inline-mock scenario traffic Open

Difficulty 4/5 3-5 days Newbie friendliness 68/100

modelcontextprotocol/conformance#418 · 2 comments · Opened Jul 27, 2026
Add conformance test (2025-06-18+): servers MUST reject JSON-RPC batch requests Open

bug

Difficulty 3/5 1-2 days Newbie friendliness 68/100

modelcontextprotocol/conformance#378 · Opened Jul 1, 2026
No client-suite scenarios for the tasks extension (io.modelcontextprotocol/tasks) Open

Difficulty 4/5 3-5 days Newbie friendliness 68/100

modelcontextprotocol/conformance#374 · 1 comment · Opened Jun 30, 2026
Authorization Server Auth: DPoP Token Binding (SEP-1932) Open

Difficulty 5/5 Over a week Newbie friendliness 45/100

modelcontextprotocol/conformance#370 · 3 comments · Opened Jun 25, 2026
Server Auth: DPoP Proof Validation (SEP-1932) Open

Difficulty 5/5 Over a week Newbie friendliness 45/100

modelcontextprotocol/conformance#369 · Opened Jun 25, 2026
test: programmatic CLI harness for src/index.ts action handlers Open

Difficulty 4/5 3-5 days Newbie friendliness 67/100

modelcontextprotocol/conformance#363 · 1 comment · Opened Jun 24, 2026
CI does not smoke-test client CLI path; everything-client drift on elicitation-sep1034-client-defaults and sse-retry Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 65/100

modelcontextprotocol/conformance#345 · 1 comment · Opened Jun 17, 2026
SEP-2243: ServerRejectsMissingMethodHeader contradicts TypeScript SDK behavior Open

Difficulty 4/5 3-5 days Newbie friendliness 42/100

modelcontextprotocol/conformance#323 · 7 comments · Opened May 29, 2026
caching scenario should use DRAFT-2026-v1 Open

bug

Difficulty 2/5 1-3 hours Newbie friendliness 72/100

modelcontextprotocol/conformance#315 · 1 comment · Opened May 24, 2026
server-stateless doesn't set `mcp-method` etc. Open

bug

Difficulty 2/5 1-3 hours Newbie friendliness 68/100

modelcontextprotocol/conformance#312 · 1 comment · Opened May 23, 2026
SEP-2575: remaining conformance tests Open

Difficulty 4/5 3-5 days Newbie friendliness 38/100

modelcontextprotocol/conformance#296 · 1 comment · Opened May 20, 2026
Add SEP-2575 conformance tests Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

modelcontextprotocol/conformance#266 · 1 comment · Opened May 12, 2026
Add support for a stdio testing Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 48/100

modelcontextprotocol/conformance#258 · 3 comments · 1 reaction · Opened Apr 29, 2026
Run local conformance against any SDK at any ref (unblocks removing vendored examples) Open

Difficulty 5/5 Over a week Newbie friendliness 45/100

modelcontextprotocol/conformance#250 · Opened Apr 24, 2026
Standardize how scenarios report setup/execution failures Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

modelcontextprotocol/conformance#248 · Opened Apr 24, 2026
Policy: do SHOULD-level (WARNING) checks count toward Tier-1 conformance? Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

modelcontextprotocol/conformance#245 · Opened Apr 24, 2026
Proposal: Tasks conformance scenarios (spec 2025-11-25) Open

Difficulty 4/5 3-5 days Newbie friendliness 48/100

modelcontextprotocol/conformance#244 · 1 comment · 1 reaction · Opened Apr 23, 2026
Add scenario option to authorization server conformance test Open

enhancement

modelcontextprotocol/conformance#226 · 1 comment · 5 reactions · 1 assignee · Opened Apr 15, 2026
Add JSON-based setup option to authorization server conformance test Open

enhancement

Difficulty 3/5 1-2 days Newbie friendliness 64/100

modelcontextprotocol/conformance#225 · 4 reactions · Opened Apr 15, 2026
Workload Identity Federation (SEP-1933) - Client Conformance Open

Difficulty 5/5 Over a week Newbie friendliness 42/100

modelcontextprotocol/conformance#223 · Opened Apr 10, 2026
tier-check reports 0/30 server conformance despite all tests passing Open

Difficulty 3/5 1-2 days Newbie friendliness 48/100

modelcontextprotocol/conformance#182 · Opened Mar 5, 2026
Spec tracking check should validate the submitted SDK release, not first-release-after-spec Open

Difficulty 4/5 3-5 days Newbie friendliness 52/100

modelcontextprotocol/conformance#167 · 3 comments · Opened Feb 24, 2026
tier-check: support monorepos with multiple SDK packages Open

Difficulty 4/5 3-5 days Newbie friendliness 35/100

modelcontextprotocol/conformance#151 · Opened Feb 15, 2026
AS issuer validation failure Open

bug

Difficulty 4/5 3-5 days Newbie friendliness 35/100

modelcontextprotocol/conformance#140 · 6 comments · 1 reaction · Opened Feb 10, 2026
Add conformance tests for authorization baseline Open

enhancement

Difficulty 4/5 3-5 days Newbie friendliness 45/100

modelcontextprotocol/conformance#116 · 2 comments · Opened Jan 22, 2026

A short digest of beginner-friendly GitHub issues.