Code

[WIP] feat: add mlp transcoders#183

Code

Draft

dtch1997 wants to merge 11 commits intojbloomAus:mainjbloomAus/SAELens:mainfrom dtch1997:feat-transcoderdtch1997/SAELens:feat-transcoderCopy head branch name to clipboard

Commits

Commits on Jun 15, 2024

• refactor: sae forward pass

  dtch1997

  committed
  3d021ae

  Copy full SHA for 3d021ae

• fix: detached sae output in forward

  dtch1997

  committed
  99f40fe

  Copy full SHA for 99f40fe

• add mlp transcoder

  dtch1997

  committed
  a58ccaa

  Copy full SHA for a58ccaa

• xfail test error term as not implemented

  dtch1997

  committed
  215bac9

  Copy full SHA for 215bac9

• add configs, light refactor of training_sae

  dtch1997

  committed
  1dd7da6

  Copy full SHA for 1dd7da6

• add transcoder training infra

  dtch1997

  committed
  406cd42

  Copy full SHA for 406cd42

• fix minor issue with multiple inheritance

  dtch1997

  committed
  9a4dccb

  Copy full SHA for 9a4dccb

• add ipykernel for running tutorials

  dtch1997

  committed
  a46ce5e

  Copy full SHA for a46ce5e

• add tutorial notebook for training mlp transcoder

  dtch1997

  committed
  0648576

  Copy full SHA for 0648576

• fix: various minor bugs

  dtch1997

  committed
  7a22a75

  Copy full SHA for 7a22a75

Commits on Jun 27, 2024

• add experiment harness

  dtch1997

  committed
  1e020d5

  Copy full SHA for 1e020d5