Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Switch to using PyTorch Lightning #195

Closed
wants to merge 40 commits into from
Closed

Switch to using PyTorch Lightning #195

wants to merge 40 commits into from

Commits on Jan 19, 2024

  1. Add pytorch lightning

    @alan-cooney
    alan-cooney committed Jan 19, 2024
    Configuration menu
    Copy the full SHA
    fe3fc2c View commit details
    Browse the repository at this point in the history

  2. Move train metrics to torchmetrics

    @alan-cooney
    alan-cooney committed Jan 19, 2024
    Configuration menu
    Copy the full SHA
    19c1fb9 View commit details
    Browse the repository at this point in the history

Commits on Jan 21, 2024

  1. Move all metrics and loss to torchmetrics

    @alan-cooney
    alan-cooney committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    0f2cb46 View commit details
    Browse the repository at this point in the history

  2. Add neuron fired count metric

    @alan-cooney
    alan-cooney committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    acde426 View commit details
    Browse the repository at this point in the history

  3. Add a lightning module version of the model

    @alan-cooney
    alan-cooney committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    6473b2a View commit details
    Browse the repository at this point in the history

Commits on Jan 23, 2024

  1. Add support for keeping the batch dimension in loss functions

    @alan-cooney
    alan-cooney committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    4192477 View commit details
    Browse the repository at this point in the history

  2. Tweak neuron activity documentation

    @alan-cooney
    alan-cooney committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    dee5e58 View commit details
    Browse the repository at this point in the history

  3. Set the default vscode testing framework

    @alan-cooney
    alan-cooney committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    466c10a View commit details
    Browse the repository at this point in the history

  4. Simplify keeping of batch dimension with autoencoder

    @alan-cooney
    alan-cooney committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    47f2b42 View commit details
    Browse the repository at this point in the history

  5. At lightning SAE support to replace activations hook

    @alan-cooney
    alan-cooney committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    bbcbcb6 View commit details
    Browse the repository at this point in the history

  6. Remove deepspeed optimizer 

    This can now be done by lightning in a simpler way
    @alan-cooney
    alan-cooney committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    13ed5b1 View commit details
    Browse the repository at this point in the history

  7. Support any type of model for the replace activations hook

    @alan-cooney
    alan-cooney committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    447b479 View commit details
    Browse the repository at this point in the history

  8. Simplify get model device

    @alan-cooney
    alan-cooney committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    33da685 View commit details
    Browse the repository at this point in the history

  9. Simplify optimizer init

    @alan-cooney
    alan-cooney committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    3731a1f View commit details
    Browse the repository at this point in the history

  10. Fix init for changed modules

    @alan-cooney
    alan-cooney committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    9ff259e View commit details
    Browse the repository at this point in the history

  11. Ignore lightning deprecated warning

    @alan-cooney
    alan-cooney committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    1692d3f View commit details
    Browse the repository at this point in the history

  12. Add lightning support to get model device

    @alan-cooney
    alan-cooney committed Jan 23, 2024
    Configuration menu
    Copy the full SHA
    76b5e2c View commit details
    Browse the repository at this point in the history

Commits on Jan 24, 2024

  1. Combine all train metrics with loss

    @alan-cooney
    alan-cooney committed Jan 24, 2024
    Configuration menu
    Copy the full SHA
    3ebadfa View commit details
    Browse the repository at this point in the history

  2. Improve lightning loss performance

    @alan-cooney
    alan-cooney committed Jan 24, 2024
    Configuration menu
    Copy the full SHA
    8505c7a View commit details
    Browse the repository at this point in the history

  3. Add a separate autoencoder loss module

    @alan-cooney
    alan-cooney committed Jan 24, 2024
    Configuration menu
    Copy the full SHA
    977f620 View commit details
    Browse the repository at this point in the history

  4. Add loss to module exports

    @alan-cooney
    alan-cooney committed Jan 24, 2024
    Configuration menu
    Copy the full SHA
    ed021a3 View commit details
    Browse the repository at this point in the history

Commits on Jan 26, 2024

  1. Add pipeline

    @alan-cooney
    alan-cooney committed Jan 26, 2024
    Configuration menu
    Copy the full SHA
    b8f0211 View commit details
    Browse the repository at this point in the history

  2. Merge remote-tracking branch 'origin/main' into lightning

    @alan-cooney
    alan-cooney committed Jan 26, 2024
    Configuration menu
    Copy the full SHA
    f32c113 View commit details
    Browse the repository at this point in the history

  3. Remove prints

    @alan-cooney
    alan-cooney committed Jan 26, 2024
    Configuration menu
    Copy the full SHA
    7164322 View commit details
    Browse the repository at this point in the history

  4. Add training step tests

    @alan-cooney
    alan-cooney committed Jan 26, 2024
    Configuration menu
    Copy the full SHA
    1a98484 View commit details
    Browse the repository at this point in the history

Commits on Jan 27, 2024

  1. Support none and 1 dimensions

    @alan-cooney
    alan-cooney committed Jan 27, 2024
    Configuration menu
    Copy the full SHA
    24c2864 View commit details
    Browse the repository at this point in the history

Commits on Jan 29, 2024

  1. Fix metric logging

    @alan-cooney
    alan-cooney committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    1b69ed3 View commit details
    Browse the repository at this point in the history

  2. Revert activation resampler and fix tests

    @alan-cooney
    alan-cooney committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    4e4c7a9 View commit details
    Browse the repository at this point in the history

  3. Support mps

    @alan-cooney
    alan-cooney committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    fb8ec8d View commit details
    Browse the repository at this point in the history

  4. Fix batch dim setting

    @alan-cooney
    alan-cooney committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    bc5f563 View commit details
    Browse the repository at this point in the history

  5. Add data parallel for HookedTransformer

    @alan-cooney
    alan-cooney committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    a491460 View commit details
    Browse the repository at this point in the history

  6. Fix docs build

    @alan-cooney
    alan-cooney committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    346cc8f View commit details
    Browse the repository at this point in the history

  7. Add reconstruction score in

    @alan-cooney
    alan-cooney committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    98bc2c6 View commit details
    Browse the repository at this point in the history

  8. Improve docs typing

    @alan-cooney
    alan-cooney committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    3900d1a View commit details
    Browse the repository at this point in the history

  9. Update packages

    @alan-cooney
    alan-cooney committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    a89abbc View commit details
    Browse the repository at this point in the history

  10. Add DataParallelWithModelAttributes to the resampler

    @alan-cooney
    alan-cooney committed Jan 29, 2024
    Configuration menu
    Copy the full SHA
    100278a View commit details
    Browse the repository at this point in the history

Commits on Jan 30, 2024

  1. Fix tests

    @alan-cooney
    alan-cooney committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    e819555 View commit details
    Browse the repository at this point in the history

  2. Remove logging if not signed in

    @alan-cooney
    alan-cooney committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    4e2f67b View commit details
    Browse the repository at this point in the history

  3. Fix logging

    @alan-cooney
    alan-cooney committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    e98e34e View commit details
    Browse the repository at this point in the history

  4. Fix loss link

    @alan-cooney
    alan-cooney committed Jan 30, 2024
    Configuration menu
    Copy the full SHA
    bb97eb1 View commit details
    Browse the repository at this point in the history