Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

support offline consolidate and reshard fsdp checkpoints #28

Merged
merged 24 commits into from
Oct 18, 2024
Merged

support offline consolidate and reshard fsdp checkpoints #28

merged 24 commits into from
Oct 18, 2024

Commits on Oct 10, 2024

  1. consolidate model and optimizer done

    @hanwen-sun
    hanwen-sun committed Oct 10, 2024
    Configuration menu
    Copy the full SHA
    39d6896 View commit details
    Browse the repository at this point in the history

Commits on Oct 11, 2024

  1. offonline_consolidate_utils_done

    @hanwen-sun
    hanwen-sun committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    5a3bd2d View commit details
    Browse the repository at this point in the history

  2. format

    @hanwen-sun
    hanwen-sun committed Oct 11, 2024
    Configuration menu
    Copy the full SHA
    b447369 View commit details
    Browse the repository at this point in the history

Commits on Oct 12, 2024

  1. fix model save path

    @hanwen-sun
    hanwen-sun committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    2dcee05 View commit details
    Browse the repository at this point in the history

  2. add clone for get shard

    @hanwen-sun
    hanwen-sun committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    622c40d View commit details
    Browse the repository at this point in the history

  3. fix ckpt_dir

    @hanwen-sun
    hanwen-sun committed Oct 12, 2024
    Configuration menu
    Copy the full SHA
    d5bf482 View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2024

  1. memory efficient

    @hanwen-sun
    hanwen-sun committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    c2365a2 View commit details
    Browse the repository at this point in the history

  2. fix typo

    @hanwen-sun
    hanwen-sun committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    bacb8ac View commit details
    Browse the repository at this point in the history

  3. rename consolidate util4

    @hanwen-sun
    hanwen-sun committed Oct 14, 2024
    Configuration menu
    Copy the full SHA
    c6af54e View commit details
    Browse the repository at this point in the history

Commits on Oct 15, 2024

  1. ut done

    @hanwen-sun
    hanwen-sun committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    128517c View commit details
    Browse the repository at this point in the history

  2. add save comments

    @hanwen-sun
    hanwen-sun committed Oct 15, 2024
    Configuration menu
    Copy the full SHA
    7260beb View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. isort

    @hanwen-sun
    hanwen-sun committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    5504402 View commit details
    Browse the repository at this point in the history

  2. refine console scripts

    @hanwen-sun
    hanwen-sun committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    920adbc View commit details
    Browse the repository at this point in the history

  3. add name pattern matching

    @hanwen-sun
    hanwen-sun committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    1758008 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2024

  1. add model and optimizer args

    @hanwen-sun
    hanwen-sun committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    2edd046 View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. add unpad

    @hanwen-sun
    hanwen-sun committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    4f7922e View commit details
    Browse the repository at this point in the history

  2. format

    @hanwen-sun
    hanwen-sun committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    9a7d16e View commit details
    Browse the repository at this point in the history

  3. refine fsdp doc

    @hanwen-sun
    hanwen-sun committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    36d14d5 View commit details
    Browse the repository at this point in the history

  4. add api

    @hanwen-sun
    hanwen-sun committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    8ad04f7 View commit details
    Browse the repository at this point in the history

  5. format

    @hanwen-sun
    hanwen-sun committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    e4bec1b View commit details
    Browse the repository at this point in the history

  6. typo

    @hanwen-sun
    hanwen-sun committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    33f0007 View commit details
    Browse the repository at this point in the history

  7. format

    @hanwen-sun
    hanwen-sun committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    77fda58 View commit details
    Browse the repository at this point in the history

  8. revert dist init

    @hanwen-sun
    hanwen-sun committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    ab32480 View commit details
    Browse the repository at this point in the history

  9. dist init isort skip

    @hanwen-sun
    hanwen-sun committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    ed42f2b View commit details
    Browse the repository at this point in the history