Code

Optimize LLaMA for inference#513

Code

Merged

justheuristic merged 4 commits intomainbigscience-workshop/petals:mainfrom optimize_llamabigscience-workshop/petals:optimize_llamaCopy head branch name to clipboardNov 14, 2023

+378-15

Commits

Commits on Oct 24, 2023

• Optimize LLaMa for inference

  mryab

  committed
  78c7f58

  Copy full SHA for 78c7f58

• Fix optimizations, test LLaMA properly

  mryab

  committed
  94b052d

  Copy full SHA for 94b052d

• Fix model type detection in tests

  mryab

  committed
  a19ccea

  Copy full SHA for a19ccea

Commits on Nov 14, 2023

• Merge branch 'main' into optimize_llama

  justheuristic

  authored
  31dfea4

  Copy full SHA for 31dfea4