Skip to content

[megatron] KDA context parallelism: opt-in all-gather exchange (SKYRL_KDA_CP_EXCHANGE=allgather) - #2437

Draft
avigyabb wants to merge 2 commits into
glm5p3-flash/context-parallelfrom
glm5p3-flash/kda-cp-allgather-exchange
Draft

[megatron] KDA context parallelism: opt-in all-gather exchange (SKYRL_KDA_CP_EXCHANGE=allgather)#2437
avigyabb wants to merge 2 commits into
glm5p3-flash/context-parallelfrom
glm5p3-flash/kda-cp-allgather-exchange

Merge glm5p3-flash/context-parallel (main) into glm5p3-flash/kda-cp-a…

7218281
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar