Skip to content

FP8 KV-Cache Compatibility for Hybrid vLLM Models#1899

Open
YJHMITWEB wants to merge 4 commits into
NovaSky-AI:mainfrom
YJHMITWEB:fp8-rl-kv-cache
Open

FP8 KV-Cache Compatibility for Hybrid vLLM Models#1899
YJHMITWEB wants to merge 4 commits into
NovaSky-AI:mainfrom
YJHMITWEB:fp8-rl-kv-cache