feat(testing): Support reusable prepared test artifacts by cameroncooke · Pull Request #475 · getsentry/XcodeBuildMCP

cameroncooke · 2026-07-16T15:55:39Z

Why

Agents and CI workflows need to prepare tests once and execute them later without falling back to raw xcodebuild. The existing build tools always finished with a normal build action, so they could not expose the reusable products produced by build-for-testing.

What Changed

Extend the existing simulator, device, and macOS build tools with buildForTesting and optional testProductsPath inputs.
Return managed .xctestproducts bundles and discovered .xctestrun files as structured build artifacts.
Let test tools execute either prepared .xctestproducts bundles or advanced .xctestrun inputs without rebuilding, while returning the new .xcresult produced by the run.
Move conditional next-step selection into tool manifests so normal builds and prepared-test builds advertise the appropriate follow-up without changing existing output behavior.
Add unit, schema, lifecycle, and MCP/CLI snapshot coverage for successful and failing prepared-test workflows.

Fixes #450

Extend existing build and test tools to prepare, return, and consume reusable test artifacts while preserving normal build behavior. Fixes #450

Move conditional next-step selection into tool manifests and preserve the behavior across MCP, CLI, daemon, and snapshot outputs. Refs #450

pkg-pr-new · 2026-07-16T15:57:34Z

Open in StackBlitz

npm i https://pkg.pr.new/xcodebuildmcp@475

commit: ae6d5ba

Keep source-only xcodebuild arguments out of the generated test-without-building phase and sort final test failures independently of emission order.

Share per-test environment setup and cleanup across snapshot suites, cache suite-level simulator builds, and normalize volatile output so fixtures remain stable. Update non-environmental fixtures and add coverage for cleanup and normalization behavior.

Prevent session defaults and selectors from leaking into prepared test runs, remove a useless simulator state initializer, and align volatile snapshot fixtures across CLI and MCP.

Keep only-testing and skip-testing arguments in the prepared test phase while retaining session-default conflict filtering.

cursor

Cursor Bugbot has reviewed your changes and found 1 potential issue.

^{❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, enable autofix in the Cursor dashboard.}

^{Reviewed by Cursor Bugbot for commit ae6d5ba. Configure here.}

cursor · 2026-07-17T19:42:44Z

        platform,
-        logPrefix: `${platform} Device Build`,
+        logPrefix: `${platform} Device ${resolved.logLabel}`,
+        deviceId: params.buildForTesting ? params.deviceId : undefined,


Session device blocks generic builds

Medium Severity

Adding deviceId to the build_device schema makes session deviceId merge into every buildForTesting call. A session device then forces a device-specific destination, so the supported generic build-for-testing path becomes unreachable without clearing session defaults, and portable products can be built for the wrong device.

Additional Locations (1)

src/mcp/tools/device/build_device.ts#L193-L202

^{Reviewed by Cursor Bugbot for commit ae6d5ba. Configure here.}

cameroncooke added 2 commits July 16, 2026 12:39

feat(xcodebuild): Support prepared test artifacts

79d6b5c

Extend existing build and test tools to prepare, return, and consume reusable test artifacts while preserving normal build behavior. Fixes #450

feat(manifest): Support conditional next steps

65b862b

Move conditional next-step selection into tool manifests and preserve the behavior across MCP, CLI, daemon, and snapshot outputs. Refs #450

cameroncooke marked this pull request as ready for review July 16, 2026 16:19

sentry-warden Bot reviewed Jul 16, 2026

View reviewed changes

Comment thread src/snapshot-tests/__fixtures__/cli/text/macos/test--failure.txt

cursor Bot reviewed Jul 16, 2026

View reviewed changes

Comment thread src/utils/test-common.ts

fix(testing): Stabilize prepared test execution

e359897

Keep source-only xcodebuild arguments out of the generated test-without-building phase and sort final test failures independently of emission order.

sentry Bot reviewed Jul 16, 2026

View reviewed changes

Comment thread src/mcp/tools/device/build_device.ts

cursor Bot reviewed Jul 16, 2026

View reviewed changes

Comment thread src/mcp/tools/device/build_device.ts

sentry-warden Bot reviewed Jul 16, 2026

View reviewed changes

Comment thread src/snapshot-tests/__fixtures__/mcp/json/simulator/test--error-compiler.json

test(snapshot): Align device test schema versions

88da782

cursor Bot reviewed Jul 16, 2026

View reviewed changes

Comment thread src/utils/test-common.ts Outdated

fix(test): Extract failures from managed result bundles

e7b8d53

cursor Bot reviewed Jul 16, 2026

View reviewed changes

Comment thread src/utils/test-common.ts

cameroncooke added 3 commits July 16, 2026 20:08

fix(test): Preserve explicit test destinations

f95b573

meta: Merge main into feature branch

c3683ea

github-code-quality Bot found potential problems Jul 17, 2026

View reviewed changes

Comment thread src/snapshot-tests/preflight/simulator.ts Fixed

cursor Bot reviewed Jul 17, 2026

View reviewed changes

Comment thread src/utils/test-source.ts

sentry Bot reviewed Jul 17, 2026

View reviewed changes

Comment thread src/utils/test-common.ts

github-actions Bot reviewed Jul 17, 2026

View reviewed changes

Comment thread src/snapshot-tests/__fixtures__/cli/json/swift-package/run--success.json Outdated

Comment thread src/snapshot-tests/__fixtures__/mcp/text/device/test--error-compiler.txt

sentry-warden Bot reviewed Jul 17, 2026

View reviewed changes

fix(testing): address prepared test review findings

a925f49

Prevent session defaults and selectors from leaking into prepared test runs, remove a useless simulator state initializer, and align volatile snapshot fixtures across CLI and MCP.

cursor Bot reviewed Jul 17, 2026

View reviewed changes

Comment thread src/utils/test-source.ts

sentry Bot reviewed Jul 17, 2026

View reviewed changes

Comment thread src/mcp/tools/macos/build_macos.ts

cameroncooke added 2 commits July 17, 2026 20:35

fix(testing): preserve prepared test selectors

2ee73fa

Keep only-testing and skip-testing arguments in the prepared test phase while retaining session-default conflict filtering.

fix(testing): only mark successful test products complete

ae6d5ba

cursor Bot reviewed Jul 17, 2026

View reviewed changes

Uh oh!

Uh oh!

Conversation

cameroncooke commented Jul 16, 2026

Why

What Changed

Uh oh!

pkg-pr-new Bot commented Jul 16, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

cursor Bot left a comment

Choose a reason for hiding this comment

Uh oh!

cursor Bot Jul 17, 2026

Choose a reason for hiding this comment

Session device blocks generic builds

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

pkg-pr-new Bot commented Jul 16, 2026 •

edited

Loading