Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

multi-gpu fused_moe tuning support #143

Open
wants to merge 20 commits into
base: main
Choose a base branch
from
Open

multi-gpu fused_moe tuning support #143

wants to merge 20 commits into from
+263 −238

Commits on Sep 17, 2024

  1. add multi-gpu tuning support with tqdm progress bar 

    - todo: add fp8 support
- todo: add comments and documentation
    @divakar-amd
    divakar-amd committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    fd16af5 View commit details
    Browse the repository at this point in the history

  2. ruff & yapf

    @divakar-amd
    divakar-amd committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    37fc500 View commit details
    Browse the repository at this point in the history

  3. kernel api update & Torchrun usage warning

    @divakar-amd
    divakar-amd committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    6f45d02 View commit details
    Browse the repository at this point in the history

  4. [nit] file mode fix

    @divakar-amd
    divakar-amd committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    ffaffcd View commit details
    Browse the repository at this point in the history

  5. ruff ruff ruff (isort)

    @divakar-amd
    divakar-amd committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    0e0608f View commit details
    Browse the repository at this point in the history

Commits on Sep 18, 2024

  1. Merge branch 'main' into distributed_fmoe_tuning

    @divakar-amd
    divakar-amd authored Sep 18, 2024
    Configuration menu
    Copy the full SHA
    86e53fd View commit details
    Browse the repository at this point in the history

Commits on Sep 21, 2024

  1. fix hardcoded top_k

    @divakar-amd
    divakar-amd authored Sep 21, 2024
    Configuration menu
    Copy the full SHA
    fd6a4ee View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. Merge branch 'main' into distributed_fmoe_tuning

    @divakar-amd
    divakar-amd authored Sep 25, 2024
    Configuration menu
    Copy the full SHA
    ab92950 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. add exception handling to see silen torchrun failures

    @divakar-amd
    divakar-amd committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    2cb34c4 View commit details
    Browse the repository at this point in the history

  2. yapf

    @divakar-amd
    divakar-amd committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    60860d9 View commit details
    Browse the repository at this point in the history

Commits on Oct 14, 2024

  1. Merge branch 'main' into distributed_fmoe_tuning

    @divakar-amd
    divakar-amd authored Oct 14, 2024
    Configuration menu
    Copy the full SHA
    1e8b1f0 View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. Merge branch 'main' into distributed_fmoe_tuning

    @divakar-amd
    divakar-amd authored Oct 16, 2024
    Configuration menu
    Copy the full SHA
    101564f View commit details
    Browse the repository at this point in the history

  2. use itertool.product for readability

    @divakar-amd
    divakar-amd committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    618663d View commit details
    Browse the repository at this point in the history

  3. re-use fused_topk function

    @divakar-amd
    divakar-amd committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    d47b89c View commit details
    Browse the repository at this point in the history

  4. yapf

    @divakar-amd
    divakar-amd committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    17f9533 View commit details
    Browse the repository at this point in the history

  5. keep the config keys sorted in multi-gpu

    @divakar-amd
    divakar-amd committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    7202911 View commit details
    Browse the repository at this point in the history

Commits on Oct 23, 2024

  1. Merge branch 'main' into distributed_fmoe_tuning

    @divakar-amd
    divakar-amd authored Oct 23, 2024
    Configuration menu
    Copy the full SHA
    dda55c8 View commit details
    Browse the repository at this point in the history

  2. add fp8 tuning support

    @divakar-amd
    divakar-amd committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    c1134b6 View commit details
    Browse the repository at this point in the history

  3. ruff + yapf

    @divakar-amd
    divakar-amd committed Oct 23, 2024
    Configuration menu
    Copy the full SHA
    0356fdd View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into distributed_fmoe_tuning

    @divakar-amd
    divakar-amd authored Oct 23, 2024
    Configuration menu
    Copy the full SHA
    72dfb5a View commit details
    Browse the repository at this point in the history