Repository navigation
[TPU/Raiden/StagingHostRam] Add num_staging_layers constructor parameter to PyTorch KVCacheManager, replacing TPU_RAIDEN_NUM_STAGING_LAYERS
#2690
| Job | Run time |
|---|---|
| 1m 1s | |
| 2m 6s | |
| 6m 9s | |
| 3m 31s | |
| 3m 48s | |
| 53s | |
| 1m 12s | |
| 18m 40s |