Skip to content

chore: run full conformance CI suite#1010

Merged
jamadeo merged 1 commit into
mainfrom
jamadeo/conformance-ci
Jul 20, 2026
Merged

chore: run full conformance CI suite#1010
jamadeo merged 1 commit into
mainfrom
jamadeo/conformance-ci

Conversation

@jamadeo

@jamadeo jamadeo commented Jul 18, 2026

Copy link
Copy Markdown
Contributor

Runs the full conformance suite, enumerating expected failures.

closes #985

Motivation and Context

Track conformance for new spec.

How Has This Been Tested?

Run the conformance tests locally and on CI.

Breaking Changes

none

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)
  • Documentation update

Checklist

  • I have read the MCP Documentation
  • My code follows the repository's style guidelines
  • New and existing tests pass locally
  • I have added appropriate error handling
  • I have added or updated documentation as needed

Additional context

@github-actions github-actions Bot added T-CI Changes to CI/CD workflows and configuration T-config Configuration file changes labels Jul 18, 2026
@jamadeo
jamadeo force-pushed the jamadeo/conformance-ci branch 2 times, most recently from c738380 to 412f266 Compare July 20, 2026 18:23
@jamadeo
jamadeo marked this pull request as ready for review July 20, 2026 18:25
@jamadeo
jamadeo requested a review from a team as a code owner July 20, 2026 18:25
@jamadeo
jamadeo force-pushed the jamadeo/conformance-ci branch 2 times, most recently from 5f25f4c to 60c79b9 Compare July 20, 2026 18:43
--url http://127.0.0.1:8002/mcp \
--suite all \
--spec-version 2026-07-28 \
--expected-failures conformance/expected-failures-2026-07-28.yaml \

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh, this is clean. I didn't know --expected-failures existed.

Comment thread conformance/src/bin/server.rs
@jamadeo
jamadeo force-pushed the jamadeo/conformance-ci branch from 60c79b9 to 005a154 Compare July 20, 2026 20:26
@jamadeo
jamadeo merged commit dd11e5b into main Jul 20, 2026
19 of 21 checks passed
@jamadeo
jamadeo deleted the jamadeo/conformance-ci branch July 20, 2026 21:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

T-CI Changes to CI/CD workflows and configuration T-config Configuration file changes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

CI: run full 2026-07-28 conformance suites instead of hand-picked scenario lists

2 participants