Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[WIP] feat: T5 support #255

Open
wants to merge 9 commits into
base: main
Choose a base branch
from
Open

[WIP] feat: T5 support #255

wants to merge 9 commits into from

Commits on Feb 7, 2024

  1. add t5 modeling code

    @AlpinDale
    AlpinDale committed Feb 7, 2024
    Configuration menu
    Copy the full SHA
    55c7a22 View commit details
    Browse the repository at this point in the history

Commits on Mar 23, 2024

  1. Merge branch 'main' into feat/t5-support

    @AlpinDale
    AlpinDale committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    b6e5080 View commit details
    Browse the repository at this point in the history

  2. update modeling code 

    Co-authored-by: Jin Shang <[email protected]>
    @AlpinDale @js8544
    AlpinDale and js8544 committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    f009f94 View commit details
    Browse the repository at this point in the history

  3. hack in custom bias for attention kernels

    @AlpinDale
    AlpinDale committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    a788ca3 View commit details
    Browse the repository at this point in the history

  4. add custom bias to attention.py

    @AlpinDale
    AlpinDale committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    58e89e2 View commit details
    Browse the repository at this point in the history

  5. enc_dec attention code

    @AlpinDale
    AlpinDale committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    3ed4cc4 View commit details
    Browse the repository at this point in the history

  6. separate prompt and genned tokens for enc-dec

    @AlpinDale
    AlpinDale committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    72659e5 View commit details
    Browse the repository at this point in the history

  7. hell

    @AlpinDale
    AlpinDale committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    f9726a3 View commit details
    Browse the repository at this point in the history

  8. do not allow context shift for enc-dec

    @AlpinDale
    AlpinDale committed Mar 23, 2024
    Configuration menu
    Copy the full SHA
    c3b15f0 View commit details
    Browse the repository at this point in the history