Skip to content

fix: scope retry health by model and region #1977

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
steebchen merged 18 commits into from
May 7, 2026
Merged

fix: scope retry health by model and region #1977

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
18 commits
Select commit Hold shift + click to select a range
b8579f3
fix: retry invalid api key payloads
steebchen Apr 6, 2026
8391b63
fix: isolate key and provider health
steebchen Apr 6, 2026
b49cce3
test: harden flaky gateway specs
steebchen Apr 7, 2026
b45c134
Merge remote-tracking branch 'origin/main' into fix/retry-invalid-api…
steebchen Apr 7, 2026
86a36d2
fix: tighten retry health scoping
steebchen Apr 11, 2026
d48275a
Merge remote-tracking branch 'origin/main' into pr-1977-review
steebchen Apr 20, 2026
f4de254
Merge remote-tracking branch 'origin/main' into pr-1977-review
steebchen Apr 27, 2026
90b4a5f
test: rename together.ai to together-ai in retry tests
steebchen Apr 27, 2026
3e208ad
Merge remote-tracking branch 'origin/main' into pr-1977-review
steebchen May 1, 2026
17e7932
Merge remote-tracking branch 'origin/main' into pr-1977-review
steebchen May 4, 2026
2cb5875
fix(stats): require retry success before excluding
steebchen May 4, 2026
551fea0
fix(health): keep auth blacklist provider-wide
steebchen May 4, 2026
3808c0e
fix(health): zero uptime when key is blacklisted
steebchen May 4, 2026
8670ffa
Merge remote-tracking branch 'origin/main' into pr-1977-review
steebchen May 4, 2026
403759b
fix(gateway): address PR review feedback
steebchen May 4, 2026
0e0ce47
Merge remote-tracking branch 'origin/main' into pr-1977-review
steebchen May 6, 2026
344ef27
fix(chat): preserve BYOK endpoint on regional env override
steebchen May 7, 2026
81ef46b
Merge branch 'main' into fix/retry-invalid-api-key-payloads
steebchen May 7, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions apps/gateway/src/api.spec.ts
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2783,11 +2783,11 @@ describe("api", () => {
expect(logs[0].hasError).toBe(true);
expect(logs[0].errorDetails?.statusCode).toBe(401);

expect(isTrackedKeyHealthy("provider-key-id-stream-auth-error")).toBe(
false,
);
expect(
getTrackedKeyMetrics("provider-key-id-stream-auth-error"),
isTrackedKeyHealthy("provider-key-id-stream-auth-error", "custom"),
).toBe(false);
expect(
getTrackedKeyMetrics("provider-key-id-stream-auth-error", "custom"),
).toMatchObject({
permanentlyBlacklisted: true,
totalRequests: 1,
Expand Down
Loading
Loading