Title: ci(conformance): run server --suite draft and baseline the 2026-07-28 scenarios by maxisbey · Pull Request #2878 · modelcontextprotocol/python-sdk · GitHub
Open Graph Title: ci(conformance): run server --suite draft and baseline the 2026-07-28 scenarios by maxisbey · Pull Request #2878 · modelcontextprotocol/python-sdk
X Title: ci(conformance): run server --suite draft and baseline the 2026-07-28 scenarios by maxisbey · Pull Request #2878 · modelcontextprotocol/python-sdk
Description: Adds the 2026-07-28 draft-spec server suite on top of #2877, mirroring typescript-sdk's two-step server job (active then draft). This is the second half of bringing the conformance harness up to date for the v2/2026 line — #2877 was the modernization, this adds the draft coverage so 2026 SEP work has a burn-down list. Motivation and Context AGENTS.md requires new 2026-07-28 features to have a passing conformance test. With #2877 the server job only runs --suite active (2025-11-25 scenarios); draft-spec server scenarios were never exercised. This adds the --suite draft step and baselines the 17 scenarios that don't pass yet, so each SEP implementation PR can remove its entries from the baseline as it lands. Changes conformance.yml: second run-server.sh --suite draft --expected-failures ... step in the server-conformance job. expected-failures.yml server:: 17 entries grouped by SEP — same set as typescript-sdk's server baseline. Two of the 19 draft scenarios (input-required-result-unsupported-methods, input-required-result-validate-input) are intentionally not baselined: their negative-case assertions are vacuously satisfied today by the stateful server's -32600 response, and the runner would flag them stale. A trailing comment records this. client: section unchanged — --suite all already covers draft client scenarios via the #2877 baseline (re-verified post-#2838: 24 pass + 16 expected-fail, exit 0). How Has This Been Tested? Run locally against @modelcontextprotocol/conformance@0.2.0-alpha.3: server --suite draft --expected-failures ... → 19 scenarios, 17 expected-fail, 0 unexpected, 0 stale, exit 0. Run twice on a fresh server each time; output byte-identical. server --suite active --expected-failures ... with the 17 server entries present → 30/30 pass, exit 0 (the evaluator ignores baseline entries not in the current run, so the draft entries don't trip the active step). client --suite all --expected-failures ... → 24 pass + 16 expected-fail, exit 0. pre-commit clean. Breaking Changes None. Types of changes Bug fix (non-breaking change which fixes an issue) New feature (non-breaking change which adds functionality) Breaking change (fix or feature that would cause existing functionality to change) Documentation update Checklist I have read the MCP Documentation My code follows the repository's style guidelines New and existing tests pass locally I have added appropriate error handling I have added or updated documentation as needed Additional context Dominant draft failure mode is -32600 Missing session ID — mcp-everything-server has no stateless mode yet, so most scenarios hit the transport wall before SEP-specific checks run. Same as typescript-sdk's baseline; the entries reshuffle once SEP-2575 lands. The harness's stale-entry check only fires for scenarios that actually ran, so a renamed/typo'd baseline entry would linger silently. Same gap exists for the client: block and in typescript-sdk; would need an upstream change to validate baseline names against the scenario registry. run-server.sh is invoked twice now; cleanup relies on uv run forwarding SIGTERM to uvicorn. Verified to work on the sequential-restart path locally. Deferred to SEP-2575 burn-down: client.py reading MCP_CONFORMANCE_PROTOCOL_VERSION (typescript-sdk doesn't either), mcp-everything-server --stateless. Follow-up on the conformance repo: add a python-sdk (main) entry to known-sdks.ts. AI Disclaimer
Open Graph Description: Adds the 2026-07-28 draft-spec server suite on top of #2877, mirroring typescript-sdk's two-step server job (active then draft). This is the second half of bringing the conformance harness up t...
X Description: Adds the 2026-07-28 draft-spec server suite on top of #2877, mirroring typescript-sdk's two-step server job (active then draft). This is the second half of bringing the conformance harness ...
Opengraph URL: https://github.com/modelcontextprotocol/python-sdk/pull/2878
X: @github
Domain: github.com
| route-pattern | /:user_id/:repository/pull/:id/files(.:format) |
| route-controller | pull_requests |
| route-action | files |
| fetch-nonce | v2:ece8b4be-0bf6-6bfe-f414-ee8ad6bc2803 |
| current-catalog-service-hash | ae870bc5e265a340912cde392f23dad3671a0a881730ffdadd82f2f57d81641b |
| request-id | A9A2:33509B:13E9FBB:1C7B137:6A5A243B |
| html-safe-nonce | 47e17286f4d8928f769b795a0f61d2fa63d76f6bca29801ea80c52737ce7fd2a |
| visitor-payload | eyJyZWZlcnJlciI6IiIsInJlcXVlc3RfaWQiOiJBOUEyOjMzNTA5QjoxM0U5RkJCOjFDN0IxMzc6NkE1QTI0M0IiLCJ2aXNpdG9yX2lkIjoiMzY1ODcxMzE3MDQyNzEyNjg0MyIsInJlZ2lvbl9lZGdlIjoiaWFkIiwicmVnaW9uX3JlbmRlciI6ImlhZCJ9 |
| visitor-hmac | b99c897bdc81d127ea99b64db7a33c291309c34e84da4a1242e76741edf0bed4 |
| hovercard-subject-tag | pull_request:3868959566 |
| github-keyboard-shortcuts | repository,pull-request-list,pull-request-conversation,pull-request-files-changed,copilot |
| google-site-verification | Apib7-x98H0j5cPqHWwSMm6dNU4GmODRoqxLiDzdx9I |
| octolytics-url | https://collector.github.com/github/collect |
| analytics-location | / |
| fb:app_id | 1401488693436528 |
| apple-itunes-app | app-id=1477376905, app-argument=https://github.com/modelcontextprotocol/python-sdk/pull/2878/files |
| twitter:image | https://avatars.githubusercontent.com/u/224885523?s=400&v=4 |
| twitter:card | summary_large_image |
| og:image | https://avatars.githubusercontent.com/u/224885523?s=400&v=4 |
| og:image:alt | Adds the 2026-07-28 draft-spec server suite on top of #2877, mirroring typescript-sdk's two-step server job (active then draft). This is the second half of bringing the conformance harness up t... |
| og:site_name | GitHub |
| og:type | object |
| hostname | github.com |
| expected-hostname | github.com |
| None | e31742e80bbd077fd5679c13ed870ce4e0c13803a2fa5beaae557b6769de2c8a |
| turbo-cache-control | no-preview |
| diff-view | unified |
| go-import | github.com/modelcontextprotocol/python-sdk git https://github.com/modelcontextprotocol/python-sdk.git |
| octolytics-dimension-user_id | 182288589 |
| octolytics-dimension-user_login | modelcontextprotocol |
| octolytics-dimension-repository_id | 862584018 |
| octolytics-dimension-repository_nwo | modelcontextprotocol/python-sdk |
| octolytics-dimension-repository_public | true |
| octolytics-dimension-repository_is_fork | false |
| octolytics-dimension-repository_network_root_id | 862584018 |
| octolytics-dimension-repository_network_root_nwo | modelcontextprotocol/python-sdk |
| turbo-body-classes | logged-out env-production page-responsive full-width |
| disable-turbo | true |
| browser-stats-url | https://api.github.com/_private/browser/stats |
| browser-errors-url | https://api.github.com/_private/browser/errors |
| release | c9fcdbf98c619d1561ed843fa01d9766a32b5cd9 |
| ui-target | full |
| theme-color | #1e2327 |
| color-scheme | light dark |
Links:
Viewport: width=device-width