Skip to content

feat: --no-cache-thoughts for reasoning-model multi-turn cache alignment#29

Draft
DavidBellamy wants to merge 11 commits into
prodfrom
feat/no-cache-thoughts-llm360-fork
Draft

feat: --no-cache-thoughts for reasoning-model multi-turn cache alignment#29
DavidBellamy wants to merge 11 commits into
prodfrom
feat/no-cache-thoughts-llm360-fork

fix(no-cache-thoughts): initialize KV-copy config for MHA pools

a8d44ec
Select commit
Loading
Failed to load commit list.