Skip to content

feat(sdk): add MTP speculative decoding to the llama_cpp backend#1185

Closed
Mengsheng Wu (mengshengwu) wants to merge 2 commits into
mainfrom
feat/llama-cpp-mtp-spec
Closed

feat(sdk): add MTP speculative decoding to the llama_cpp backend#1185
Mengsheng Wu (mengshengwu) wants to merge 2 commits into
mainfrom
feat/llama-cpp-mtp-spec

test(sdk): add --draft-model/--draft-tokens to geniex-bench for MTP

155f0eb
Select commit
Loading
Failed to load commit list.
GitHub Advanced Security / Semgrep OSS succeeded Jul 16, 2026 in 2s

No new alerts in code changed by this pull request

View all branch alerts.