feat: TrueFoundry resilience pivot — three fault-injection demo scenarios - #8

Merged

henryqingmo merged 29 commits into

mainfrom

eval-gate2

May 28, 2026

Commits on May 26, 2026

cleaned up fake infrastructure (fake mcp, fake upstream, old placeholders), rewired eval suite to use real localstripe tool, added AI agent eval + HTTP eval server
Tom-Shuhong-Tang
committed
99ebae5
chore: update localstripe_demo to b2d7273 (eval-trigger service)

Tom-Shuhong-Tang
and
claude
committed
5329a0e

Commits on May 28, 2026

fixed eval to run test
Tom-Shuhong-Tang
committed
48d1eff
feat: add eval web UI and custom eval endpoint

Tom-Shuhong-Tang
and
claude
committed
cd00680
chore: update localstripe_demo to 9fc10bc (seed entrypoint + demo charges)

Tom-Shuhong-Tang
and
claude
committed
dfb44e1
docs: add TrueFoundry resilience pivot design spec

henryqingmo
and
claude
committed
a35dbed
docs: add TrueFoundry resilience pivot implementation plan

henryqingmo
and
claude
committed
4c608a0
feat(eval-runner): accept upstream_error policyOutcome
henryqingmo
committed
2c3fb8d
feat(gateway): write upstream_error audit record on forwarder failure
henryqingmo
committed
50c0c74
feat(gateway): write expired audit record on approval timeout

henryqingmo
and
claude
committed
489a0ec
feat(gateway): make approval timeout configurable via APPROVAL_LOCK_TTL env var
henryqingmo
committed
33457b3
feat(compose): add mock-slack service and wire APPROVAL_LOCK_TTL + SLACK_API_BASE_URL
henryqingmo
committed
6b618eb
feat(evalsuite): add resilience eval cases for mcp-down and approval-timeout
henryqingmo
committed
396a831
feat: add demo-resilience script and make target for TrueFoundry submission

henryqingmo
and
claude
committed
56fdf00
fix(eval-runner): require policyOutcome field in eval cases
henryqingmo
committed
0c471a8
Apply suggestion from @gemini-code-assist[bot]

henryqingmo
and
gemini-code-assist[bot]
authored
8f62c6f
Apply suggestion from @gemini-code-assist[bot]

henryqingmo
and
gemini-code-assist[bot]
authored
d183066
Apply suggestion from @gemini-code-assist[bot]

henryqingmo
and
gemini-code-assist[bot]
authored
aefa200
fix: resolve port conflict in demo-resilience script

henryqingmo
and
claude
committed
49bed8e
feat: cache initialize/tools-list responses for upstream-down resilience

henryqingmo
and
claude
committed
d351d23
fix: warm gateway capability cache before fault injection

henryqingmo
and
claude
committed
86172cf
fix: add eval-trigger healthcheck and Makefile build-compose-bins target

henryqingmo
and
claude
committed
b47751b
fix: poll audit_log until terminal decision record appears

henryqingmo
and
claude
committed
cb592c6
fix: allow upstream_error and expired in audit_log decision constraint

henryqingmo
and
claude
committed
21b0362
fix: remove timeout command (not available on macOS)

henryqingmo
and
claude
committed
653291e
fix: wait for localstripe-mcp health before Scenario 3

henryqingmo
and
claude
committed
854456d
fix: make demo-resilience 3/3 pass — seed data, per-scenario YAML, session warm-up

henryqingmo
and
claude
committed
7c4ebb3
merge: integrate remote Gemini suggestions, keep tested resilience fixes

henryqingmo
and
claude
committed
f0e596c
Merge remote-tracking branch 'origin/main' into eval-gate2
henryqingmo
committed
c857c9d

Navigation Menu

feat: TrueFoundry resilience pivot — three fault-injection demo scenarios - #8

feat: TrueFoundry resilience pivot — three fault-injection demo scenarios#8
henryqingmo merged 29 commits into
mainfrom
eval-gate2

Commits on May 26, 2026

cleaned up fake infrastructure (fake mcp, fake upstream, old placeholders), rewired eval suite to use real localstripe tool, added AI agent eval + HTTP eval server

chore: update localstripe_demo to b2d7273 (eval-trigger service)

Commits on May 28, 2026

fixed eval to run test

feat: add eval web UI and custom eval endpoint

chore: update localstripe_demo to 9fc10bc (seed entrypoint + demo charges)

docs: add TrueFoundry resilience pivot design spec

docs: add TrueFoundry resilience pivot implementation plan

feat(eval-runner): accept upstream_error policyOutcome

feat(gateway): write upstream_error audit record on forwarder failure

feat(gateway): write expired audit record on approval timeout

feat(gateway): make approval timeout configurable via APPROVAL_LOCK_TTL env var

feat(compose): add mock-slack service and wire APPROVAL_LOCK_TTL + SLACK_API_BASE_URL

feat(evalsuite): add resilience eval cases for mcp-down and approval-timeout

feat: add demo-resilience script and make target for TrueFoundry submission

fix(eval-runner): require policyOutcome field in eval cases

Apply suggestion from @gemini-code-assist[bot]

Apply suggestion from @gemini-code-assist[bot]

Apply suggestion from @gemini-code-assist[bot]

fix: resolve port conflict in demo-resilience script

feat: cache initialize/tools-list responses for upstream-down resilience

fix: warm gateway capability cache before fault injection

fix: add eval-trigger healthcheck and Makefile build-compose-bins target

fix: poll audit_log until terminal decision record appears

fix: allow upstream_error and expired in audit_log decision constraint

fix: remove timeout command (not available on macOS)

fix: wait for localstripe-mcp health before Scenario 3

fix: make demo-resilience 3/3 pass — seed data, per-scenario YAML, session warm-up

merge: integrate remote Gemini suggestions, keep tested resilience fixes

Merge remote-tracking branch 'origin/main' into eval-gate2