Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add support for (vision) transformers, add options to set last-layer relevance #15

Draft
wants to merge 26 commits into
base: main
Choose a base branch
from
Draft

Add support for (vision) transformers, add options to set last-layer relevance #15

wants to merge 26 commits into from

Commits on Mar 7, 2024

  1. add option to normalize / set output relevances

    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    c213416 View commit details
    Browse the repository at this point in the history

  2. start adding package extension for vision transformers

    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    1ed33fd View commit details
    Browse the repository at this point in the history

  3. add NNlib to weakdeps

    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    a80ba77 View commit details
    Browse the repository at this point in the history

  4. fix merge conflict

    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst committed Mar 7, 2024
    Configuration menu
    Copy the full SHA
    4822aa7 View commit details
    Browse the repository at this point in the history

Commits on Mar 15, 2024

  1. fix dependencies for extension

    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    b07335a View commit details
    Browse the repository at this point in the history

  2. add extension

    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    4f79949 View commit details
    Browse the repository at this point in the history

  3. add options to specify last layer relevance

    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    9f6d5e2 View commit details
    Browse the repository at this point in the history

  4. fix imports

    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    bfc9e70 View commit details
    Browse the repository at this point in the history

  5. add canonization for SkipConnection layers; fix model splitting edge … 

    …case
    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    5604403 View commit details
    Browse the repository at this point in the history

  6. Merge pull request #1 from Maximilian-Stefan-Ernst/hotfix/canonize 

    add canonization for SkipConnection layers; fix model splitting edge …
    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst authored Mar 15, 2024
    Configuration menu
    Copy the full SHA
    27b22d2 View commit details
    Browse the repository at this point in the history

  7. fix formatting

    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    655b51d View commit details
    Browse the repository at this point in the history

  8. fix flatten_model edge case

    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    f8762e1 View commit details
    Browse the repository at this point in the history

  9. add tests for flatten_model and canonize

    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    4e14408 View commit details
    Browse the repository at this point in the history

  10. Merge pull request #2 from Maximilian-Stefan-Ernst/hotfix/canonize 

    Hotfix/canonize
    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst authored Mar 15, 2024
    Configuration menu
    Copy the full SHA
    8e606b5 View commit details
    Browse the repository at this point in the history

  11. fix in prepare_vit

    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    72dcc76 View commit details
    Browse the repository at this point in the history

  12. formatter

    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst committed Mar 15, 2024
    Configuration menu
    Copy the full SHA
    e7c7bac View commit details
    Browse the repository at this point in the history

Commits on Mar 19, 2024

  1. Merge branch 'attention' into main

    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst authored Mar 19, 2024
    Configuration menu
    Copy the full SHA
    06b4280 View commit details
    Browse the repository at this point in the history

  2. Merge pull request #3 from Maximilian-Stefan-Ernst/main 

    Merge upstream changes in main
    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst authored Mar 19, 2024
    Configuration menu
    Copy the full SHA
    13ba2b7 View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2024

  1. Revert "add options to specify last layer relevance" 

    This reverts commit 9f6d5e2.
    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    e4721fd View commit details
    Browse the repository at this point in the history

  2. Revert "add option to normalize / set output relevances" 

    This reverts commit c213416.
    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    d464696 View commit details
    Browse the repository at this point in the history

  3. remove NNlib dependency

    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    f680bd6 View commit details
    Browse the repository at this point in the history

  4. rename extension

    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    31ac29b View commit details
    Browse the repository at this point in the history

  5. rename files to new extension name & make prepare_vit part of canonize

    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    6cac3e7 View commit details
    Browse the repository at this point in the history

  6. move extension rules to src/rules.jl

    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    e2c7e30 View commit details
    Browse the repository at this point in the history

  7. tell users they have to load Metalhead to use the rules

    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    17da330 View commit details
    Browse the repository at this point in the history

  8. remove prepare_vit from exports; format

    @Maximilian-Stefan-Ernst
    Maximilian-Stefan-Ernst committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    79b2d40 View commit details
    Browse the repository at this point in the history