Skip to content

Add SBproxy to Serving section#377

Open
rickcrawford wants to merge 1 commit intotensorchord:mainfrom
rickcrawford:add-sbproxy
Open

Add SBproxy to Serving section#377
rickcrawford wants to merge 1 commit intotensorchord:mainfrom
rickcrawford:add-sbproxy

Conversation

@rickcrawford
Copy link
Copy Markdown

@rickcrawford rickcrawford commented Apr 12, 2026

Add SBproxy to the Serving section.

SBproxy is a single-binary AI gateway that routes LLM traffic across 103+ providers with:

  • Cost-based routing (cheapest provider per model)
  • Multi-provider failover and load balancing
  • Rate limiting and budget controls per API key/team
  • AI guardrails (PII, secrets, content filtering)
  • Semantic response caching
  • Request/response transforms

Written in Go, single binary, YAML config. Apache 2.0.

Signed-off-by: Rick Crawford [email protected]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant