perf(sample-support): add packed base64 transport#1915

Open

dyurk-lila wants to merge 10 commits into

NovaSky-AI:mainfrom

dyurk-lila:upstream/sample-support-packed-wire

Commits on Jul 20, 2026

fix(r3): align routed-expert metadata and padding
dyurk-lila
committed
perf(r3): accelerate routed-expert transport with packed arrays

dyurk-lila
and
claude
committed
perf(r3): expand replay routes to local layers only

dyurk-lila
and
claude
committed
refactor(inference): extract reusable RemoteInferenceGenerator

dyurk-lila
and
claude
committed
refactor(generators): assemble routed-expert traces incrementally

dyurk-lila
and
claude
committed
test(generators): drop obsolete turn route argument
dyurk-lila
committed
feat(megatron): add bounded sampler-support replay

dyurk-lila
and
claude
committed
fix(sample-support): repair rows where the sampled token is absent from its top-k support (#66)

dyurk-lila
and
claude
committed
feat(fsdp): add bounded sampler-support replay

dyurk-lila
and
claude
committed
perf(sample-support): add packed base64 transport

dyurk-lila
and
claude
committed