feat(sdk): add MTP speculative decoding to the llama_cpp backend#1185
Closed
Mengsheng Wu (mengshengwu) wants to merge 2 commits into
Closed
feat(sdk): add MTP speculative decoding to the llama_cpp backend#1185Mengsheng Wu (mengshengwu) wants to merge 2 commits into
Mengsheng Wu (mengshengwu) wants to merge 2 commits into
