Code

use_fuse_mask_softmax#412

Code

Open

xiezipeng-ML wants to merge 3 commits intomainOneflow-Inc/libai:mainfrom use_fuse_mask_softmaxOneflow-Inc/libai:use_fuse_mask_softmaxCopy head branch name to clipboard

+43-10

Commits

Commits on Oct 28, 2022

• use fuse multi head att

  

  xiezipeng-ML

  authored and

  xiezipeng-ML

  committed
  a1fc307

  Copy full SHA for a1fc307

• use batch size = 4, acc step = 8, amp, open Checkpointing

  xiezipeng-ML

  committed
  5cf55a6

  Copy full SHA for 5cf55a6

Commits on Nov 1, 2022

• add activation checkpoint

  xiezipeng-ML

  committed
  1c2ada8

  Copy full SHA for 1c2ada8