Skip to content

Pull requests: radixark/Megatron-LM

New pull request New
34 Open 36 Closed
34 Open 36 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

TOP dense parity for Qwen3 on Blackwell: flashinfer attention, batch-invariant kernel seam, non-reentrant recompute
#70 opened Jul 20, 2026 by adrenaline21 Loading…
Handle step key correctly in dp_reshardable checkpoint save with --optimizer-cpu-offload
#69 opened Jul 16, 2026 by artkorenev Loading…
1
[tml] Inkling model support
#68 opened Jul 15, 2026 by Zhichenzzz Loading…
fix(true-on-policy): match SGLang's row-linear k-tile reduction order
#65 opened Jul 9, 2026 by zihaow211 Loading…
1
feat(optimizer): NVMe streaming of DistributedOptimizer state
#63 opened Jul 8, 2026 by yueming-yuan Loading…
[optim] run plan/metadata coordination over a gloo group
#62 opened Jul 7, 2026 by yueming-yuan Loading…
[optim] bucket checkpoint save to avoid CPU memory spike during ckpt saving
#61 opened Jul 6, 2026 by yueming-yuan Loading…
v4 mxfp4
#59 opened Jun 19, 2026 by xiuhu17 • Draft
Fix GB300 torch_dist checkpoint save crashes from forked local writers
#57 opened Jun 17, 2026 by zyzshishui Loading…
6 tasks
Add TV (total-variation) loss option for the MTP draft head
#56 opened Jun 16, 2026 by ElliotXinqiWang Loading…
fix(mtp): rename MTP submodule transformer_layer -> mtp_model_layer
#54 opened Jun 8, 2026 by Zhichenzzz Loading…
1
Megatron: Nemotron RL support
#51 opened Jun 3, 2026 by Zhichenzzz Loading…
[15/15] Cover fast top-k routing contract
#48 opened May 26, 2026 by maocheng23 Loading…
[14/15] Cover true-on-policy SGLang extension wiring
#47 opened May 26, 2026 by maocheng23 Loading…
[13/15] Wire fused MoE backward kernel launcher
#46 opened May 26, 2026 by maocheng23 Loading…
[12/15] Add fused MoE top-k weight backward kernel
#45 opened May 26, 2026 by maocheng23 Loading…
[11/15] Add fused MoE backward weight kernel
#44 opened May 26, 2026 by maocheng23 Loading…
[10/15] Add fused MoE backward input kernel
#43 opened May 26, 2026 by maocheng23 Loading…
[9/15] Add autograd wrapper for SGLang fused MoE
#42 opened May 26, 2026 by maocheng23 Loading…
[8/15] Add SGLang fused MoE forward wrapper
#41 opened May 26, 2026 by maocheng23 Loading…
[7/15] Complete true-on-policy MoE EP forward orchestration
#40 opened May 26, 2026 by maocheng23 Loading…
[6/15] Add true-on-policy MoE EP entrypoints
#39 opened May 26, 2026 by maocheng23 Loading…
[5/15] Adapt Megatron grouped experts to SGLang layout
#38 opened May 26, 2026 by maocheng23 Loading…
[4/15] Gate true-on-policy MoE execution
#37 opened May 26, 2026 by maocheng23 Loading…
[3/15] Select SGLang parity paths from transformer config
#36 opened May 26, 2026 by maocheng23 Loading…
ProTip! Adding no:label will show everything without a label.