You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
pressure under the frozen policy. This does not establish that increasing the
125
+
budget would necessarily resolve those tasks.
124
126
125
127
#### Termination and correctness
126
128
@@ -131,17 +133,19 @@ budget would solve the task.
131
133
|`model-failed` → officially resolved |**1**|
132
134
|`finished` → officially unresolved |**3**|
133
135
134
-
> **Termination status is not a correctness proxy.** Official grading remains
135
-
> the correctness authority for this benchmark.
136
+
> **Termination status should not be used as a substitute for evaluator-derived
137
+
> resolution.** Termination reasons remain useful operational and diagnostic
138
+
> signals.
136
139
137
140
#### Research Note
138
141
139
-
**[Auditing Runtime Termination as a Correctness Proxy for Coding Agents: A Frozen SWE-bench Verified Mini Case Study](docs/research/runtime-termination-correctness-proxy.md)**
142
+
**[Auditing Runtime Termination as a Resolution Proxy: A Frozen Coding-Agent Case Study](docs/research/runtime-termination-correctness-proxy.md)**
140
143
141
-
An artifact-grounded measurement audit of typed runtime termination as a
142
-
correctness proxy under one frozen configuration. The mechanical
0 commit comments