Code

add softmax_d for mha_bwd#1161

Code

Open

MayDomine wants to merge 8 commits intoDao-AILab:mainDao-AILab/flash-attention:mainfrom MayDomine:opt_bwdMayDomine/flash-attention:opt_bwdCopy head branch name to clipboard

+118-116

Commits

Commits on Apr 1, 2024

• WIP: add softmax_d

  MayDomine

  committed
  1ee6c46

  Copy full SHA for 1ee6c46

• add softmax_d as optional in mha_bwd

  MayDomine

  committed
  b15bf43

  Copy full SHA for b15bf43

• Merge branch 'Dao-AILab:main' into main

  MayDomine

  authored
  0cf3f14

  Copy full SHA for 0cf3f14

Commits on Apr 2, 2024

• fix interface

  MayDomine

  committed
  a8be5aa

  Copy full SHA for a8be5aa

Commits on Apr 8, 2024

• fix api cpp

  MayDomine

  committed
  26ef937

  Copy full SHA for 26ef937

• fix api cpp

  MayDomine

  committed
  2561763

  Copy full SHA for 2561763

• fix interface

  MayDomine

  committed
  d437be5

  Copy full SHA for d437be5

Commits on Aug 19, 2024

• needs to clear dq when pass softmax_d

  MayDomine

  committed
  d8a502c

  Copy full SHA for d8a502c