Code

Support Qwen2-MoE models#2723

Code

Merged

lvhan028 merged 7 commits intoInternLM:mainInternLM/lmdeploy:mainfrom lzhangzz:moe2lzhangzz/lmdeploy:moe2Copy head branch name to clipboardNov 13, 2024

+711-190

Commits

Commits on Nov 7, 2024

• add qwen2-moe

  lzhangzz

  committed
  e0b221e

  Copy full SHA for e0b221e

• eliminate inter_size_ from ffn layer

  lzhangzz

  committed
  cea0524

  Copy full SHA for cea0524

• clean up

  lzhangzz

  committed
  b7d050a

  Copy full SHA for b7d050a

• fix lint

  lzhangzz

  committed
  8fade57

  Copy full SHA for 8fade57

• clean up

  lzhangzz

  committed
  4c0f902

  Copy full SHA for 4c0f902

Commits on Nov 11, 2024

• Update config.yaml

  zhulinJulia24

  authored
  7447b73

  Copy full SHA for 7447b73

• Merge branch 'main' into moe2

  zhulinJulia24

  authored
  fd17b0f

  Copy full SHA for fd17b0f