Skip to content

[v5] 跳过单位温度缩放并缩减 NCCL 广播 - #398

Merged
tastelikefeet merged 4 commits into
dev-swift-v5from
perf/rl-logits-nccl-payload
Nov 18, 2026
Merged

tastelikefeet merged 4 commits into
dev-swift-v5from
perf/rl-logits-nccl-payload

Conversation

@qychen2001

@qychen2001 qychen2001 commented Nov 18, 2026 •

Copy link
Copy Markdown
Collaborator

PR type

  • Bug Fix
  • New Feature
  • Document Updates
  • More Models or Datasets Support

PR information

  • HF 和 Megatron 在 temperature=1.0 时跳过全词表 logits 除法。
  • NCCL 双缓冲只广播桶内有效字节,省掉空白区的传输。

Experiment results

以下为 HF GRPO 主链路的原始对照。Qwen3.5-4B,8 张 PPU,同配置各跑 5 步。

指标 修改前 修改后
NCCL 单次广播量 21.00 GiB 16.91 GiB
第 2–4 步单次权重同步 1.035 s 0.930 s
5 步训练循环耗时 513.25 s 511.75 s
训练总 token 吞吐 1,949 token/s 1,955 token/s

固定 64 条真实轨迹回放,前反向平均 13.48 → 13.10 s,预热后每组测两次。

qychen2001 and others added 4 commits November 18, 2026 19:17
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: Codex <codex@openai.com>
Co-authored-by: Codex <codex@openai.com>
@tastelikefeet
tastelikefeet merged commit 56b2a95 into dev-swift-v5 Nov 18, 2026
0 of 6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants