fix(ci): align release checks with AgentPatchCheck #22
aravelo7ci.yml
on: push
test
/
windows-release-artifact-smoke
9m 40s
test
/
headless-core
1m 32s
Matrix: test / build-check-test
Annotations
15 errors and 4 warnings
|
test / headless-core
Process completed with exit code 1.
|
|
test/agentpatchcheck/swebench-cli.test.ts > SWE-bench CLI post-run orchestration > admits a clean canonical formal startup at a non-baseline HEAD and reaches the AgentRuntime boundary:
src/agentpatchcheck/swebench-cli.ts#L333
SWEbenchEvaluatorPreflightError: evaluator_preflight_failed: evaluator-python-unavailable; evaluatorSourceRoot=/tmp/apc-swebench-canonical-pre-agent-LjS1Hi/test-evaluator; expectedRevision=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb; actualRevision=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb
❯ preflightSWEbenchEvaluator src/agentpatchcheck/swebench-cli.ts:333:9
❯ Object.runEvaluatorPreflight test/agentpatchcheck/swebench-cli.test.ts:428:5
❯ runSWEbenchCli src/agentpatchcheck/swebench-cli.ts:634:2
❯ test/agentpatchcheck/swebench-cli.test.ts:441:3
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { code: 'evaluator_preflight_failed', failedChecks: [ 'evaluator-python-unavailable' ], evaluatorSourceRoot: '/tmp/apc-swebench-canonical-pre-agent-LjS1Hi/test-evaluator', expectedRevision: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb', actualRevision: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' }
|
|
test/agentpatchcheck/harness-native-runtime.test.ts > Harness-native Agent Runtime > applies a multi-line LF request to a CRLF file while preserving CRLF output:
test/agentpatchcheck/harness-native-runtime.test.ts#L2078
AssertionError: expected { version: 1, …(23) } to match object { status: 'succeeded', toolCalls: 1 }
(95 matching properties omitted from actual)
- Expected
+ Received
{
"status": "succeeded",
- "toolCalls": 1,
+ "toolCalls": 0,
}
❯ test/agentpatchcheck/harness-native-runtime.test.ts:2078:19
|
|
test / build-check-test (macos-latest, 22)
Process completed with exit code 1.
|
|
test/agentpatchcheck/task-definition-snapshot.test.ts > Task Definition snapshots > persists one normalized, content-addressed definition outside the disposable worktree:
test/agentpatchcheck/task-definition-snapshot.test.ts#L58
AssertionError: expected { version: 1, policy: { …(22) } } to match object { version: 1, policy: { …(5) } }
(36 matching properties omitted from actual)
- Expected
+ Received
@@ -1,17 +1,17 @@
{
"policy": {
"agentScript": {
- "path": "/var/folders/d8/hvxvltxn0fl4rmnd52sncbth0000gn/T/agentpatchcheck-task-definition-NghoK1/agent.mjs",
+ "path": "/private/var/folders/d8/hvxvltxn0fl4rmnd52sncbth0000gn/T/agentpatchcheck-task-definition-NghoK1/agent.mjs",
"sha256": "8bd84068849db1cf74863fdff2bc74704c33efb8fafe33347274fc758a63b302",
},
"executionBootstrap": {
"timeoutMs": 300000,
},
"hiddenOracle": {
"script": {
- "path": "/var/folders/d8/hvxvltxn0fl4rmnd52sncbth0000gn/T/agentpatchcheck-task-definition-NghoK1/hidden-oracle.mjs",
+ "path": "/private/var/folders/d8/hvxvltxn0fl4rmnd52sncbth0000gn/T/agentpatchcheck-task-definition-NghoK1/hidden-oracle.mjs",
"sha256": "8bd84068849db1cf74863fdff2bc74704c33efb8fafe33347274fc758a63b302",
},
},
"prompt": "Repair the parser without exposing credentials.",
"worktreeRoot": "/Users/runner/work/agentpatchcheck/agentpatchcheck/.agentpatchcheck/task-definition-test/worktrees",
❯ test/agentpatchcheck/task-definition-snapshot.test.ts:58:21
|
|
test/agentpatchcheck/swebench-cli.test.ts > SWE-bench CLI post-run orchestration > admits a clean canonical formal startup at a non-baseline HEAD and reaches the AgentRuntime boundary:
src/agentpatchcheck/swebench-cli.ts#L333
SWEbenchEvaluatorPreflightError: evaluator_preflight_failed: evaluator-python-unavailable; evaluatorSourceRoot=/var/folders/d8/hvxvltxn0fl4rmnd52sncbth0000gn/T/apc-swebench-canonical-pre-agent-dDNH18/test-evaluator; expectedRevision=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb; actualRevision=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb
❯ preflightSWEbenchEvaluator src/agentpatchcheck/swebench-cli.ts:333:9
❯ Object.runEvaluatorPreflight test/agentpatchcheck/swebench-cli.test.ts:428:5
❯ runSWEbenchCli src/agentpatchcheck/swebench-cli.ts:634:2
❯ test/agentpatchcheck/swebench-cli.test.ts:441:3
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { code: 'evaluator_preflight_failed', failedChecks: [ 'evaluator-python-unavailable' ], evaluatorSourceRoot: '/var/folders/d8/hvxvltxn0fl4rmnd52sncbth0000gn/T/apc-swebench-canonical-pre-agent-dDNH18/test-evaluator', expectedRevision: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb', actualRevision: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' }
|
|
test/agentpatchcheck/swebench-adapter.test.ts > SWE-bench Multilingual adapter > resolves and validates the repository root from instance metadata:
test/agentpatchcheck/swebench-adapter.test.ts#L74
AssertionError: expected '/private/var/folders/d8/hvxvltxn0fl4r…' to be '/var/folders/d8/hvxvltxn0fl4rmnd52snc…' // Object.is equality
Expected: "/var/folders/d8/hvxvltxn0fl4rmnd52sncbth0000gn/T/apc-swebench-repository-resolution-xM1Lrs/.agentpatchcheck/swebench/repositories/gin-gonic__gin"
Received: "/private/var/folders/d8/hvxvltxn0fl4rmnd52sncbth0000gn/T/apc-swebench-repository-resolution-xM1Lrs/.agentpatchcheck/swebench/repositories/gin-gonic__gin"
❯ test/agentpatchcheck/swebench-adapter.test.ts:74:69
|
|
test/agentpatchcheck/runtime-record.test.ts > Harness-native durable Runtime record > accepts a durable checkpoint for mutation attributed on an error result:
test/agentpatchcheck/runtime-record.test.ts#L609
AssertionError: promise rejected "Error: Runtime worktree no longer resolve…" instead of resolving
❯ test/agentpatchcheck/runtime-record.test.ts:609:4
Caused by: Caused by: Error: Runtime worktree no longer resolves to its recorded Git worktree.
❯ Object.assertRepositoryState src/agentpatchcheck/harness-native-runtime.ts:305:11
❯ assertHarnessNativeWorktreeResumeSafe src/agentpatchcheck/runtime-record.ts:284:2
❯ Function.open src/agentpatchcheck/runtime-record.ts:164:4
❯ test/agentpatchcheck/runtime-record.test.ts:603:3
|
|
test/agentpatchcheck/runtime-record.test.ts > Harness-native durable Runtime record > fails closed when the worktree drifts or a durable tool dispatch has no result:
test/agentpatchcheck/runtime-record.test.ts#L481
AssertionError: expected [Function] to throw error including 'latest durable checkpoint' but got 'Runtime worktree no longer resolves t…'
Expected: "latest durable checkpoint"
Received: "Runtime worktree no longer resolves to its recorded Git worktree."
❯ test/agentpatchcheck/runtime-record.test.ts:481:4
|
|
test/agentpatchcheck/runtime-record.test.ts > Harness-native durable Runtime record > resumes the same attempt without resetting iteration or Provider-call consumption:
src/agentpatchcheck/runtime-record.ts#L163
Error: Runtime record identity does not match the requested task or worktree.
❯ Function.open src/agentpatchcheck/runtime-record.ts:163:11
❯ src/agentpatchcheck/harness-native-runtime.ts:619:21
❯ LockedFileSystem.withLocks src/fs/locked-file-system.ts:108:11
❯ LockedFileSystem.withLock src/fs/locked-file-system.ts:93:10
❯ withHarnessNativeRuntimeRecordLock src/agentpatchcheck/runtime-record.ts:190:9
❯ Object.execute src/agentpatchcheck/harness-native-runtime.ts:613:12
❯ test/agentpatchcheck/runtime-record.test.ts:417:17
|
|
test/agentpatchcheck/harness-native-runtime.test.ts > Harness-native Agent Runtime > applies a multi-line LF request to a CRLF file while preserving CRLF output:
test/agentpatchcheck/harness-native-runtime.test.ts#L2078
AssertionError: expected { version: 1, …(23) } to match object { status: 'succeeded', toolCalls: 1 }
(95 matching properties omitted from actual)
- Expected
+ Received
{
"status": "succeeded",
- "toolCalls": 1,
+ "toolCalls": 0,
}
❯ test/agentpatchcheck/harness-native-runtime.test.ts:2078:19
|
|
test/agentpatchcheck/dsh-compatible-code-runtime.test.ts > DSH-compatible code runtime > binds ambient cwd, direct filesystem, subprocess, and structured tools to the managed workspace:
test/agentpatchcheck/dsh-compatible-code-runtime.test.ts#L52
AssertionError: expected '{\n "cwd": "/private/var/folders/d8/…' to contain '"/var/folders/d8/hvxvltxn0fl4rmnd52sn…'
- Expected
+ Received
- "/var/folders/d8/hvxvltxn0fl4rmnd52sncbth0000gn/T/agentpatchcheck-dsh-cwd-L8z4pa"
+ {
+ "cwd": "/private/var/folders/d8/hvxvltxn0fl4rmnd52sncbth0000gn/T/agentpatchcheck-dsh-cwd-L8z4pa",
+ "childCwd": "/private/var/folders/d8/hvxvltxn0fl4rmnd52sncbth0000gn/T/agentpatchcheck-dsh-cwd-L8z4pa",
+ "direct": "workspace-marker\n",
+ "firstLine": "workspace-marker",
+ "envKeys": []
+ }
❯ test/agentpatchcheck/dsh-compatible-code-runtime.test.ts:52:31
|
|
test / build-check-test (ubuntu-latest, 22)
Process completed with exit code 1.
|
|
test/agentpatchcheck/swebench-cli.test.ts > SWE-bench CLI post-run orchestration > admits a clean canonical formal startup at a non-baseline HEAD and reaches the AgentRuntime boundary:
src/agentpatchcheck/swebench-cli.ts#L333
SWEbenchEvaluatorPreflightError: evaluator_preflight_failed: evaluator-python-unavailable; evaluatorSourceRoot=/tmp/apc-swebench-canonical-pre-agent-pSYR6C/test-evaluator; expectedRevision=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb; actualRevision=bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb
❯ preflightSWEbenchEvaluator src/agentpatchcheck/swebench-cli.ts:333:9
❯ Object.runEvaluatorPreflight test/agentpatchcheck/swebench-cli.test.ts:428:5
❯ runSWEbenchCli src/agentpatchcheck/swebench-cli.ts:634:2
❯ test/agentpatchcheck/swebench-cli.test.ts:441:3
⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯⎯
Serialized Error: { code: 'evaluator_preflight_failed', failedChecks: [ 'evaluator-python-unavailable' ], evaluatorSourceRoot: '/tmp/apc-swebench-canonical-pre-agent-pSYR6C/test-evaluator', expectedRevision: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb', actualRevision: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' }
|
|
test/agentpatchcheck/harness-native-runtime.test.ts > Harness-native Agent Runtime > applies a multi-line LF request to a CRLF file while preserving CRLF output:
test/agentpatchcheck/harness-native-runtime.test.ts#L2078
AssertionError: expected { version: 1, …(23) } to match object { status: 'succeeded', toolCalls: 1 }
(95 matching properties omitted from actual)
- Expected
+ Received
{
"status": "succeeded",
- "toolCalls": 1,
+ "toolCalls": 0,
}
❯ test/agentpatchcheck/harness-native-runtime.test.ts:2078:19
|
|
test / headless-core
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-node@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
test / build-check-test (macos-latest, 22)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-node@v4, actions/setup-python@v5. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
test / build-check-test (ubuntu-latest, 22)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-node@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|
|
test / windows-release-artifact-smoke
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-node@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
|