Repository navigation

Add the `kv_evicted_blocks_total` (`tpu_raiden_kv_evicted_blocks_total`) counter metric to `tpu_raiden` telemetry and instrument `KVCacheStore` to record host DRAM LRU evictions labeled by `{dp_rank}`. - #1396

Merged

copybara-service[bot] merged 1 commit into

mainfrom

Nov 2, 2026

Merged

Add the `kv_evicted_blocks_total` (`tpu_raiden_kv_evicted_blocks_total`) counter metric to `tpu_raiden` telemetry and instrument `KVCacheStore` to record host DRAM LRU evictions labeled by `{dp_rank}`.#1396
copybara-service[bot] merged 1 commit into
mainfrom
test_999559864

Commits on Nov 2, 2026
- Add the `kv_evicted_blocks_total` (`tpu_raiden_kv_evicted_blocks_total`) counter metric to `tpu_raiden` telemetry and instrument `KVCacheStore` to record host DRAM LRU evictions labeled by `{dp_ran…
  
  itarun
  authored and
  copybara-github
  committed
  0bc13ad