Code

Enable ZeRO with auto parallel#9288

Code

Merged

mergify[bot] merged 10 commits intomasterOneflow-Inc/oneflow:masterfrom feat-auto_parallel-ZeROOneflow-Inc/oneflow:feat-auto_parallel-ZeROCopy head branch name to clipboardNov 4, 2022

+56-95

Commits

Commits on Oct 22, 2022

• Enable ZeRO with auto parallel in the first setting

  Show description for 54771bc
  Yipeng1994

  committed
  54771bc

  Copy full SHA for 54771bc

Commits on Nov 3, 2022

• Remove compute_cost parameter

  Show description for d7ab8c9
  Yipeng1994

  committed
  d7ab8c9

  Copy full SHA for d7ab8c9

• Move the addition of wait time into sbp_node

  Yipeng1994

  committed
  021f30e

  Copy full SHA for 021f30e

• Remove transfer cost since it is merged into the GetTransferCost()

  Yipeng1994

  committed
  ad38ff1

  Copy full SHA for ad38ff1

• Rename mainstem to trunk

  Yipeng1994

  committed
  02486af

  Copy full SHA for 02486af

• Merge branch 'master' into feat-auto_parallel-ZeRO

  Yipeng1994

  authored
  8e4c063

  Copy full SHA for 8e4c063

• Update warning

  Yipeng1994

  committed
  17956e0

  Copy full SHA for 17956e0

• Merge branch 'feat-auto_parallel-ZeRO' of github.com:Oneflow-Inc/oneflow into feat-auto_parallel-ZeRO

  Yipeng1994

  committed
  c29d464

  Copy full SHA for c29d464

Commits on Nov 4, 2022

• Merge branch 'master' into feat-auto_parallel-ZeRO

  Yipeng1994

  authored
  2a3f564

  Copy full SHA for 2a3f564

• Merge branch 'master' into feat-auto_parallel-ZeRO

  mergify[bot]

  authored
  a092846

  Copy full SHA for a092846