Add Support for Batching to Downstreams in Router#60

Open

dchoi-viant wants to merge 67 commits into

router-batching

Commits on Nov 26, 2025

Commits on Dec 2, 2025

Router now can detect and check signatures.
dchoi-viant
committed

Commits on Dec 3, 2025

Add support for multiple routers using the same Triton Inference service with model management.
dchoi-viant
committed

Commits on Dec 8, 2025

Retroactively remove support for stating float as an alias for float32
dchoi-viant
committed

Commits on Jan 26, 2026

Commits on Jan 27, 2026

Clean up client Prometheus setup, better buckets for batch sizes, add export Prometheus options to CLI.
dchoi-viant
committed

Commits on Jan 29, 2026

Commits on Jan 30, 2026

Commits on Feb 2, 2026

Add back queueing, minor fix in router config init, refactor router tests.
dchoi-viant
committed

Commits on Feb 4, 2026

Add ARCHITECTURE doc, minor comment updates, removed unused method (technically breaking, but should've been an unused API surface).
dchoi-viant
committed

Commits on Feb 12, 2026

Update ARCHITECTURE.md to clarify potential design issues and enhance descriptions of client batching payload features.
dchoi-viant
committed

Commits on Feb 27, 2026

Add debugging binaries to gitignore, comment router.
dchoi-viant
committed

Commits on Mar 2, 2026

Commits on Mar 3, 2026

Commits on Mar 11, 2026

Update documentation for dictionary hash behavior.
dchoi-viant
committed

Commits on Apr 6, 2026

add client support for outputing intended outputs to a file
dchoi-viant
committed

Commits on Apr 24, 2026

fix(server handler): no longer swallow Marshal error
dchoi-viant
committed

Commits on Apr 28, 2026

Commits on Apr 30, 2026

Commits on May 1, 2026

Commits on Jun 10, 2026

Commits on Jun 16, 2026

Commits on Jul 1, 2026

Commits on Jul 7, 2026

Commits on Jul 13, 2026

Merge pull request #63 from viant/triton-output-order-by-name
dchoi-viant
authored