perf(Spec Decode): skip dead-position compute in draft catch-up step(decode)#217

Merged

LorrinWWW merged 22 commits into

lightseekorg:mainfrom

rjzhb:feat/eagle-draft-single-token

May 28, 2026

Commits on May 26, 2026

Commits on May 27, 2026

Merge branch 'main' into feat/eagle-draft-single-token
rjzhb
authored
fix(eagle3): mirror draft_first_step_reduce on idle DP ranks
rjzhb
committed
fix(eagle3): guard llama Eagle3 reduce slice against idle DP ranks
rjzhb
committed
feat(eagle3): support draft first-step reduce for DeepSeek NextN
rjzhb
committed
feat(eagle3): support draft first-step reduce for Qwen3.5 MTP
rjzhb
committed
refactor(eagle3): drop per-model supports_draft_first_step_reduce flag
rjzhb
committed
chore(eagle3): trim verbose comments on reduce path
rjzhb
committed
chore(eagle3): replace EAGLE-only wording on draft_first_step_reduce comments
rjzhb
committed
fix(eagle3): align MoE collectives and final-norm decision with draft reduce
rjzhb
committed
fix(deepseek-nextn): delegate final norm to comm_manager for fused allreduce
rjzhb
committed

Commits on May 28, 2026

Merge branch 'main' into feat/eagle-draft-single-token
LorrinWWW
authored