Skip to content

feat(sdk): add MTP speculative decoding to the llama_cpp backend#1185

Closed
Mengsheng Wu (mengshengwu) wants to merge 2 commits into
mainfrom
feat/llama-cpp-mtp-spec
Closed

feat(sdk): add MTP speculative decoding to the llama_cpp backend#1185
Mengsheng Wu (mengshengwu) wants to merge 2 commits into
mainfrom
feat/llama-cpp-mtp-spec

test(sdk): add --draft-model/--draft-tokens to geniex-bench for MTP

155f0eb
Select commit
Loading
Failed to load commit list.
DCO / DCO succeeded Jul 16, 2026 in 1s

DCO

All commits are signed off!

View more details on DCO