Skip to content

Implements the kv_save_blocks_total counter metric (tpu_raiden_kv_save_blocks_total{dp_rank, tier, outcome}) to track block save outcomes across KV cache offload tiers: - #1371

Merged
copybara-service[bot] merged 1 commit into
mainfrom
test_999559866
Nov 2, 2026
Merged

Implements the kv_save_blocks_total counter metric (tpu_raiden_kv_save_blocks_total{dp_rank, tier, outcome}) to track block save outcomes across KV cache offload tiers:#1371
copybara-service[bot] merged 1 commit into
mainfrom
test_999559866

Commits

  1. Commits on Nov 2, 2026