Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Ladder 1xC #677

Open
wants to merge 193 commits into
base: main
Choose a base branch
from
Open

Ladder 1xC #677

wants to merge 193 commits into from

Commits on Jun 25, 2024

  1. scaffolding for scaling laws

    @AkshitaB
    AkshitaB committed Jun 25, 2024
    Configuration menu
    Copy the full SHA
    7b697e1 View commit details
    Browse the repository at this point in the history

Commits on Jun 28, 2024

  1. Merge branch 'main' into scaling-laws

    @AkshitaB
    AkshitaB committed Jun 28, 2024
    Configuration menu
    Copy the full SHA
    b0690c5 View commit details
    Browse the repository at this point in the history

Commits on Jul 11, 2024

  1. initial commit

    @AkshitaB
    AkshitaB committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    577f9b9 View commit details
    Browse the repository at this point in the history

  2. minor fixes

    @AkshitaB
    AkshitaB committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    676dbe4 View commit details
    Browse the repository at this point in the history

  3. move mode

    @AkshitaB
    AkshitaB committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    3509268 View commit details
    Browse the repository at this point in the history

  4. more minor cleanup

    @AkshitaB
    AkshitaB committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    53bdf67 View commit details
    Browse the repository at this point in the history

  5. changelog

    @AkshitaB
    AkshitaB committed Jul 11, 2024
    Configuration menu
    Copy the full SHA
    b823249 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'main' into scaling-laws

    @AkshitaB
    AkshitaB authored Jul 11, 2024
    Configuration menu
    Copy the full SHA
    9d2b687 View commit details
    Browse the repository at this point in the history

Commits on Jul 16, 2024

  1. Add scaling law for extrapolating model sizes

    @liujch1998
    liujch1998 committed Jul 16, 2024
    Configuration menu
    Copy the full SHA
    21a65bd View commit details
    Browse the repository at this point in the history

Commits on Jul 17, 2024

  1. Code aesthetics

    @liujch1998
    liujch1998 committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    75dcda6 View commit details
    Browse the repository at this point in the history

  2. Better config keys

    @liujch1998
    liujch1998 committed Jul 17, 2024
    Configuration menu
    Copy the full SHA
    23b3b71 View commit details
    Browse the repository at this point in the history

Commits on Jul 20, 2024

  1. Add amberish7 and Amber

    @liujch1998
    liujch1998 committed Jul 20, 2024
    Configuration menu
    Copy the full SHA
    db988a2 View commit details
    Browse the repository at this point in the history

Commits on Jul 27, 2024

  1. fix eos token

    @AkshitaB
    AkshitaB committed Jul 27, 2024
    Configuration menu
    Copy the full SHA
    32a68cd View commit details
    Browse the repository at this point in the history

  2. update scripts

    @AkshitaB
    AkshitaB committed Jul 27, 2024
    Configuration menu
    Copy the full SHA
    53a185d View commit details
    Browse the repository at this point in the history

  3. Handle the case where the directory doesn't exist

    @dirkgr @AkshitaB
    dirkgr authored and AkshitaB committed Jul 27, 2024
    Configuration menu
    Copy the full SHA
    c3cf975 View commit details
    Browse the repository at this point in the history

  4. only jupiter

    @AkshitaB
    AkshitaB committed Jul 27, 2024
    Configuration menu
    Copy the full SHA
    672d5fe View commit details
    Browse the repository at this point in the history

Commits on Jul 30, 2024

  1. Jointly fit N and D; Switch to Huber loss and L-BFGS

    @liujch1998
    liujch1998 committed Jul 30, 2024
    Configuration menu
    Copy the full SHA
    7843207 View commit details
    Browse the repository at this point in the history

Commits on Aug 1, 2024

  1. add 530M

    @AkshitaB
    AkshitaB committed Aug 1, 2024
    Configuration menu
    Copy the full SHA
    e4d5953 View commit details
    Browse the repository at this point in the history

Commits on Aug 2, 2024

  1. Fix 700m model size

    @liujch1998
    liujch1998 committed Aug 2, 2024
    Configuration menu
    Copy the full SHA
    014a2f6 View commit details
    Browse the repository at this point in the history

Commits on Aug 5, 2024

  1. Merge branch 'main' into ladder-1xC

    @AkshitaB
    AkshitaB authored Aug 5, 2024
    Configuration menu
    Copy the full SHA
    474705b View commit details
    Browse the repository at this point in the history

  2. make it amberish

    @AkshitaB
    AkshitaB committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    0eb302d View commit details
    Browse the repository at this point in the history

  3. update device batch size

    @AkshitaB
    AkshitaB committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    bde12b6 View commit details
    Browse the repository at this point in the history

  4. smaller device batch

    @AkshitaB
    AkshitaB committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    ce126fc View commit details
    Browse the repository at this point in the history

  5. add 3b

    @AkshitaB
    AkshitaB committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    d6bbf23 View commit details
    Browse the repository at this point in the history

  6. fsdp

    @AkshitaB
    AkshitaB committed Aug 5, 2024
    Configuration menu
    Copy the full SHA
    6d5abb4 View commit details
    Browse the repository at this point in the history

Commits on Aug 6, 2024

  1. Merge branch 'scaling-laws' into ladder-1xC

    @AkshitaB
    AkshitaB committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    d344502 View commit details
    Browse the repository at this point in the history

  2. isort scripts

    @AkshitaB
    AkshitaB committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    25de998 View commit details
    Browse the repository at this point in the history

  3. make batch size configurable

    @AkshitaB
    AkshitaB committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    58989b9 View commit details
    Browse the repository at this point in the history

  4. notebook

    @AkshitaB
    AkshitaB committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    e2b4a15 View commit details
    Browse the repository at this point in the history

  5. update priority to high

    @AkshitaB
    AkshitaB committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    85356d8 View commit details
    Browse the repository at this point in the history

  6. device batch size arg

    @AkshitaB
    AkshitaB committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    73cea01 View commit details
    Browse the repository at this point in the history

Commits on Aug 7, 2024

  1. bug fix

    @AkshitaB
    AkshitaB committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    8b9673f View commit details
    Browse the repository at this point in the history

  2. expected flops

    @AkshitaB
    AkshitaB committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    d5f6e5d View commit details
    Browse the repository at this point in the history

  3. somewhat hacky fix

    @AkshitaB
    AkshitaB committed Aug 7, 2024
    Configuration menu
    Copy the full SHA
    13640f2 View commit details
    Browse the repository at this point in the history

Commits on Aug 18, 2024

  1. Add 300m curve and remove 20m curve; Improve data; Tweak loss and opt… 

    …imizer
    @liujch1998
    liujch1998 committed Aug 18, 2024
    Configuration menu
    Copy the full SHA
    18e062c View commit details
    Browse the repository at this point in the history

  2. New correction term

    @liujch1998
    liujch1998 committed Aug 18, 2024
    Configuration menu
    Copy the full SHA
    053b4e7 View commit details
    Browse the repository at this point in the history

Commits on Aug 23, 2024

  1. Merge branch 'main' into ladder-1xC

    @liujch1998
    liujch1998 committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    bc69b11 View commit details
    Browse the repository at this point in the history

  2. Add bpb evals (less csqa and siqa); Change eval_interval to 100

    @liujch1998
    liujch1998 committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    86223e1 View commit details
    Browse the repository at this point in the history

  3. Remove sciq_rc_0shot_bpb

    @liujch1998
    liujch1998 committed Aug 23, 2024
    Configuration menu
    Copy the full SHA
    bf62545 View commit details
    Browse the repository at this point in the history

Commits on Aug 26, 2024

  1. Add power_correction; Add fitting to final loss

    @liujch1998
    liujch1998 committed Aug 26, 2024
    Configuration menu
    Copy the full SHA
    ae394bc View commit details
    Browse the repository at this point in the history

Commits on Aug 27, 2024

  1. add notebook

    @AkshitaB
    AkshitaB committed Aug 27, 2024
    Configuration menu
    Copy the full SHA
    21a5180 View commit details
    Browse the repository at this point in the history

  2. Update CHANGELOG.md

    @AkshitaB
    AkshitaB authored Aug 27, 2024
    Configuration menu
    Copy the full SHA
    8701299 View commit details
    Browse the repository at this point in the history

Commits on Aug 28, 2024

  1. Merge branch 'scaling-laws' into ladder-1xC

    @AkshitaB
    AkshitaB committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    acd21d0 View commit details
    Browse the repository at this point in the history

  2. Loss curve fitting

    @liujch1998
    liujch1998 committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    e3e02ec View commit details
    Browse the repository at this point in the history

  3. Add tissue function fitting

    @liujch1998
    liujch1998 committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    514910d View commit details
    Browse the repository at this point in the history

  4. Merge branch 'scaling-laws' of github.com:allenai/OLMo into scaling-laws

    @liujch1998
    liujch1998 committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    74d61f1 View commit details
    Browse the repository at this point in the history

  5. Merge branch 'scaling-laws' into ladder-1xC

    @liujch1998
    liujch1998 committed Aug 28, 2024
    Configuration menu
    Copy the full SHA
    6d80e93 View commit details
    Browse the repository at this point in the history

Commits on Aug 29, 2024

  1. move ladder to olmo so that functions can be imported

    @AkshitaB
    AkshitaB committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    9e156d2 View commit details
    Browse the repository at this point in the history

  2. add parse_run_name

    @AkshitaB
    AkshitaB committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    990a38b View commit details
    Browse the repository at this point in the history

  3. add flops based plots

    @AkshitaB
    AkshitaB committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    e180bea View commit details
    Browse the repository at this point in the history

  4. Split loss curve figures

    @liujch1998
    liujch1998 committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    1134317 View commit details
    Browse the repository at this point in the history

  5. simplify plots for final loss prediction

    @AkshitaB
    AkshitaB committed Aug 29, 2024
    Configuration menu
    Copy the full SHA
    d63622d View commit details
    Browse the repository at this point in the history

Commits on Aug 31, 2024

  1. Merge remote-tracking branch 'origin/main' into ladder-1xC

    @liujch1998
    liujch1998 committed Aug 31, 2024
    Configuration menu
    Copy the full SHA
    6a8bac9 View commit details
    Browse the repository at this point in the history

  2. Add 5-shot evals to ladder

    @liujch1998
    liujch1998 committed Aug 31, 2024
    Configuration menu
    Copy the full SHA
    d10fc35 View commit details
    Browse the repository at this point in the history

  3. Change eval interval to 200

    @liujch1998
    liujch1998 committed Aug 31, 2024
    Configuration menu
    Copy the full SHA
    4b01f8a View commit details
    Browse the repository at this point in the history

  4. Fix ladder path

    @liujch1998
    liujch1998 committed Aug 31, 2024
    Configuration menu
    Copy the full SHA
    de8721b View commit details
    Browse the repository at this point in the history

  5. Fix ladder bug

    @liujch1998
    liujch1998 committed Aug 31, 2024
    Configuration menu
    Copy the full SHA
    6d6eeb9 View commit details
    Browse the repository at this point in the history

  6. Move ladder.py back to scripts/

    @liujch1998
    liujch1998 committed Aug 31, 2024
    Configuration menu
    Copy the full SHA
    1bff5f8 View commit details
    Browse the repository at this point in the history

  7. Change save interval to 200

    @liujch1998
    liujch1998 committed Aug 31, 2024
    Configuration menu
    Copy the full SHA
    44a863a View commit details
    Browse the repository at this point in the history

Commits on Sep 3, 2024

  1. Add 5-shot evals

    @liujch1998
    liujch1998 committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    2b37b33 View commit details
    Browse the repository at this point in the history

  2. add params, add bpb to task score

    @AkshitaB
    AkshitaB committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    cc5316c View commit details
    Browse the repository at this point in the history

  3. fix lint

    @AkshitaB
    AkshitaB committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    f7fb4ea View commit details
    Browse the repository at this point in the history

  4. ruff check

    @AkshitaB
    AkshitaB committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    762be69 View commit details
    Browse the repository at this point in the history

  5. Make alpha_f configurable

    @liujch1998
    liujch1998 committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    d9aff15 View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2024

  1. cleanup notebooks, add downloads for downstream

    @AkshitaB
    AkshitaB committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    7ac4191 View commit details
    Browse the repository at this point in the history

  2. piqa and mmlu

    @AkshitaB
    AkshitaB committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    8ceb4c0 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2024

  1. add remaining downstream metrics

    @AkshitaB
    AkshitaB committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    7e4886b View commit details
    Browse the repository at this point in the history

  2. Final loss: allow averaging over last N ckpts; Loss curve: plotting r… 

    …esidue and some ablations
    @liujch1998
    liujch1998 committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    b74a021 View commit details
    Browse the repository at this point in the history

  3. Make num_to_avg a CLI arg

    @liujch1998
    liujch1998 committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    1447fea View commit details
    Browse the repository at this point in the history

  4. fix names

    @AkshitaB
    AkshitaB committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    ec7b875 View commit details
    Browse the repository at this point in the history

  5. Make save/eval_intervals CLI arguments in ladder

    @liujch1998
    liujch1998 committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    29f7c04 View commit details
    Browse the repository at this point in the history

Commits on Sep 8, 2024

  1. Update to amberish-rulebased

    @liujch1998
    liujch1998 committed Sep 8, 2024
    Configuration menu
    Copy the full SHA
    6e0b790 View commit details
    Browse the repository at this point in the history

  2. Import Vera evals

    @liujch1998
    liujch1998 committed Sep 8, 2024
    Configuration menu
    Copy the full SHA
    0c816eb View commit details
    Browse the repository at this point in the history

  3. Update amberish1 configs

    @liujch1998
    liujch1998 committed Sep 8, 2024
    Configuration menu
    Copy the full SHA
    7f30694 View commit details
    Browse the repository at this point in the history

  4. Fix amberish1 launch script

    @liujch1998
    liujch1998 committed Sep 8, 2024
    Configuration menu
    Copy the full SHA
    6d690e4 View commit details
    Browse the repository at this point in the history

  5. Fix amberish1 config to match old run

    @liujch1998
    liujch1998 committed Sep 8, 2024
    Configuration menu
    Copy the full SHA
    249fe1e View commit details
    Browse the repository at this point in the history

Commits on Sep 11, 2024

  1. update downstream notebook

    @AkshitaB
    AkshitaB committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    8424f46 View commit details
    Browse the repository at this point in the history

  2. final plots

    @AkshitaB
    AkshitaB committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    f6466f8 View commit details
    Browse the repository at this point in the history

  3. Add newline format of MMLU

    @liujch1998
    liujch1998 committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    f15af87 View commit details
    Browse the repository at this point in the history

  4. Debugging inf bpb

    @liujch1998
    liujch1998 committed Sep 11, 2024
    Configuration menu
    Copy the full SHA
    2ee876d View commit details
    Browse the repository at this point in the history

Commits on Sep 12, 2024

  1. Fix off-by-one error in byte len computation

    @liujch1998
    liujch1998 committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    b3f3934 View commit details
    Browse the repository at this point in the history

  2. Bug fix on MMLU newline

    @liujch1998
    liujch1998 committed Sep 12, 2024
    Configuration menu
    Copy the full SHA
    c3e4d43 View commit details
    Browse the repository at this point in the history

Commits on Sep 15, 2024

  1. Update plotting

    @liujch1998
    liujch1998 committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    f2f3a30 View commit details
    Browse the repository at this point in the history

  2. Update amberish1 training and wandb download

    @liujch1998
    liujch1998 committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    ddf9dbd View commit details
    Browse the repository at this point in the history

  3. Add newline format for oe-eval tasks

    @liujch1998
    liujch1998 committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    48b17e2 View commit details
    Browse the repository at this point in the history

  4. Bug fix: Switch order of OEEvalTask and OEEvalTaskWithNewlin

    @liujch1998
    liujch1998 committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    499ac18 View commit details
    Browse the repository at this point in the history

  5. Fix off-by-one error in byte len computation

    @liujch1998
    liujch1998 committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    df15f3c View commit details
    Browse the repository at this point in the history

  6. Fix wandb download

    @liujch1998
    liujch1998 committed Sep 15, 2024
    Configuration menu
    Copy the full SHA
    7b5f1c3 View commit details
    Browse the repository at this point in the history

Commits on Sep 16, 2024

  1. fix arc c

    @AkshitaB
    AkshitaB committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    2797ac8 View commit details
    Browse the repository at this point in the history

  2. temp notebook to debug step1 predictions

    @AkshitaB
    AkshitaB committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    ae2e3e6 View commit details
    Browse the repository at this point in the history

  3. update

    @AkshitaB
    AkshitaB committed Sep 16, 2024
    Configuration menu
    Copy the full SHA
    c2d7ff6 View commit details
    Browse the repository at this point in the history

Commits on Sep 17, 2024

  1. make print optional

    @AkshitaB
    AkshitaB committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    630378a View commit details
    Browse the repository at this point in the history

  2. downstream notebooks

    @AkshitaB
    AkshitaB committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    6916410 View commit details
    Browse the repository at this point in the history

  3. updated notebooks

    @AkshitaB
    AkshitaB committed Sep 17, 2024
    Configuration menu
    Copy the full SHA
    898c148 View commit details
    Browse the repository at this point in the history

Commits on Sep 19, 2024

  1. Update notebooks: Made ideal points and p0 task-specific; Added avg u… 

    …nsigned error; Remove {hellaswag-0shot, sciq, copa}; Apply moving average on both bpb and score
    @liujch1998
    liujch1998 committed Sep 19, 2024
    Configuration menu
    Copy the full SHA
    89e2f2a View commit details
    Browse the repository at this point in the history

Commits on Sep 20, 2024

  1. Update notebooks: Add back sciq; Remove moving average for score

    @liujch1998
    liujch1998 committed Sep 20, 2024
    Configuration menu
    Copy the full SHA
    e5b3fb4 View commit details
    Browse the repository at this point in the history

Commits on Sep 25, 2024

  1. Update plotting

    @liujch1998
    liujch1998 committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    7ce1424 View commit details
    Browse the repository at this point in the history

  2. Add Peteish ladder code

    @liujch1998
    liujch1998 committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    31aa023 View commit details
    Browse the repository at this point in the history

  3. Fix weka path of data and checkpoints

    @liujch1998
    liujch1998 committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    790ae81 View commit details
    Browse the repository at this point in the history

  4. Fix save folder

    @liujch1998
    liujch1998 committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    a9fe456 View commit details
    Browse the repository at this point in the history

  5. wip: stacked predictions

    @AkshitaB
    AkshitaB committed Sep 25, 2024
    Configuration menu
    Copy the full SHA
    42e28a5 View commit details
    Browse the repository at this point in the history

Commits on Sep 26, 2024

  1. Add --batch_size_divisor option

    @liujch1998
    liujch1998 committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    172bd2e View commit details
    Browse the repository at this point in the history

  2. Update param count

    @liujch1998
    liujch1998 committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    9d67aae View commit details
    Browse the repository at this point in the history

  3. Update model names

    @liujch1998
    liujch1998 committed Sep 26, 2024
    Configuration menu
    Copy the full SHA
    1f1fa6a View commit details
    Browse the repository at this point in the history

Commits on Sep 27, 2024

  1. clean stacked predictions notebook, token-based hard setting

    @AkshitaB
    AkshitaB committed Sep 27, 2024
    Configuration menu
    Copy the full SHA
    eb627dd View commit details
    Browse the repository at this point in the history

Commits on Sep 30, 2024

  1. Update peteish config

    @liujch1998
    liujch1998 committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    3bef95f View commit details
    Browse the repository at this point in the history

  2. deal with 4k seq len

    @AkshitaB
    AkshitaB committed Sep 30, 2024
    Configuration menu
    Copy the full SHA
    b54d802 View commit details
    Browse the repository at this point in the history

Commits on Oct 1, 2024

  1. add temp failsafe

    @AkshitaB
    AkshitaB committed Oct 1, 2024
    Configuration menu
    Copy the full SHA
    bc9d770 View commit details
    Browse the repository at this point in the history

Commits on Oct 2, 2024

  1. debug

    @AkshitaB
    AkshitaB committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    1bfb456 View commit details
    Browse the repository at this point in the history

  2. revert

    @AkshitaB
    AkshitaB committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    c1f2cd9 View commit details
    Browse the repository at this point in the history

  3. debug statements

    @AkshitaB
    AkshitaB committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    2840367 View commit details
    Browse the repository at this point in the history

  4. fix

    @AkshitaB
    AkshitaB committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    37dfe5e View commit details
    Browse the repository at this point in the history

  5. fix again

    @AkshitaB
    AkshitaB committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    9ce96e6 View commit details
    Browse the repository at this point in the history

  6. additional sanity check

    @AkshitaB
    AkshitaB committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    0689fe8 View commit details
    Browse the repository at this point in the history

  7. forward slash

    @AkshitaB
    AkshitaB committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    8670241 View commit details
    Browse the repository at this point in the history

  8. revert

    @AkshitaB
    AkshitaB committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    c027e36 View commit details
    Browse the repository at this point in the history

  9. weird slash issue

    @AkshitaB
    AkshitaB committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    d1b5838 View commit details
    Browse the repository at this point in the history

  10. weird slash issue 2

    @AkshitaB
    AkshitaB committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    3d0c901 View commit details
    Browse the repository at this point in the history

  11. revert

    @AkshitaB
    AkshitaB committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    ae55c7c View commit details
    Browse the repository at this point in the history

  12. print save_folder

    @AkshitaB
    AkshitaB committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    3baee24 View commit details
    Browse the repository at this point in the history

  13. fix

    @AkshitaB
    AkshitaB committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    7881c9c View commit details
    Browse the repository at this point in the history

  14. fix down the line instead

    @AkshitaB
    AkshitaB committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    2218d82 View commit details
    Browse the repository at this point in the history

  15. more logging

    @AkshitaB
    AkshitaB committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    9d31a0c View commit details
    Browse the repository at this point in the history

  16. fix ladder code for s3

    @AkshitaB
    AkshitaB committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    9afc8f2 View commit details
    Browse the repository at this point in the history

  17. save sequentially

    @AkshitaB
    AkshitaB committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    2fc3e05 View commit details
    Browse the repository at this point in the history

  18. fix backwards compatibility

    @AkshitaB
    AkshitaB committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    5ead531 View commit details
    Browse the repository at this point in the history

  19. increase retries to be safe

    @AkshitaB
    AkshitaB committed Oct 2, 2024
    Configuration menu
    Copy the full SHA
    0445efd View commit details
    Browse the repository at this point in the history

Commits on Oct 4, 2024

  1. add a normal priority script

    @AkshitaB
    AkshitaB committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    bae32b7 View commit details
    Browse the repository at this point in the history

  2. executable

    @AkshitaB
    AkshitaB committed Oct 4, 2024
    Configuration menu
    Copy the full SHA
    53d50ad View commit details
    Browse the repository at this point in the history

Commits on Oct 16, 2024

  1. move to script

    @AkshitaB
    AkshitaB committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    51dc7dd View commit details
    Browse the repository at this point in the history

  2. fix formatting, etc

    @AkshitaB
    AkshitaB committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    f453883 View commit details
    Browse the repository at this point in the history

  3. more lint fixes

    @AkshitaB
    AkshitaB committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    538d330 View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into ladder-1xC

    @AkshitaB
    AkshitaB authored Oct 16, 2024
    Configuration menu
    Copy the full SHA
    f0d6c92 View commit details
    Browse the repository at this point in the history

  5. move file

    @AkshitaB
    AkshitaB committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    16698a1 View commit details
    Browse the repository at this point in the history

  6. remove old notebooks

    @AkshitaB
    AkshitaB committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    f179641 View commit details
    Browse the repository at this point in the history

Commits on Oct 17, 2024

  1. fix linting in notebooks

    @AkshitaB
    AkshitaB committed Oct 17, 2024
    Configuration menu
    Copy the full SHA
    ea63c8c View commit details
    Browse the repository at this point in the history

Commits on Oct 18, 2024

  1. eval scripts

    @AkshitaB
    AkshitaB committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    e7b59de View commit details
    Browse the repository at this point in the history

  2. simplify

    @AkshitaB
    AkshitaB committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    2f2ed09 View commit details
    Browse the repository at this point in the history

  3. change workspace

    @AkshitaB
    AkshitaB committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    bfb4c8b View commit details
    Browse the repository at this point in the history

  4. add missing script

    @AkshitaB
    AkshitaB committed Oct 18, 2024
    Configuration menu
    Copy the full SHA
    93083c2 View commit details
    Browse the repository at this point in the history

Commits on Oct 22, 2024

  1. update downstream scripts

    @AkshitaB
    AkshitaB committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    3929e20 View commit details
    Browse the repository at this point in the history

  2. configure last n points

    @AkshitaB
    AkshitaB committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    654c60c View commit details
    Browse the repository at this point in the history

  3. updates

    @AkshitaB
    AkshitaB committed Oct 22, 2024
    Configuration menu
    Copy the full SHA
    c6f4495 View commit details
    Browse the repository at this point in the history

Commits on Oct 25, 2024

  1. Fix PPL val data

    @liujch1998
    liujch1998 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    5f4e26f View commit details
    Browse the repository at this point in the history

  2. Add WSD schedule

    @liujch1998
    liujch1998 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    a89c9d8 View commit details
    Browse the repository at this point in the history

  3. Update

    @liujch1998
    liujch1998 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    9f389ed View commit details
    Browse the repository at this point in the history

  4. Fix ladder_peteish.sh

    @liujch1998
    liujch1998 committed Oct 25, 2024
    Configuration menu
    Copy the full SHA
    efe2bac View commit details
    Browse the repository at this point in the history

Commits on Oct 27, 2024

  1. Debug NCCL timeout

    @liujch1998
    liujch1998 committed Oct 27, 2024
    Configuration menu
    Copy the full SHA
    9b47dad View commit details
    Browse the repository at this point in the history

Commits on Oct 28, 2024

  1. Changing to another port

    @liujch1998
    liujch1998 committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    93d2c2a View commit details
    Browse the repository at this point in the history

  2. Try c10d backedn

    @liujch1998
    liujch1998 committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    283caaa View commit details
    Browse the repository at this point in the history

  3. Remove printing peak_gpu_memory()

    @liujch1998
    liujch1998 committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    bd0065d View commit details
    Browse the repository at this point in the history

  4. Debug peak_gpu_memory()

    @liujch1998
    liujch1998 committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    72b1173 View commit details
    Browse the repository at this point in the history

  5. Inspecting barrier

    @liujch1998
    liujch1998 committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    0da84ef View commit details
    Browse the repository at this point in the history

  6. Inspecting barrier

    @liujch1998
    liujch1998 committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    1b8192d View commit details
    Browse the repository at this point in the history

  7. Inspecting barrier

    @liujch1998
    liujch1998 committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    d4a1a04 View commit details
    Browse the repository at this point in the history

  8. Disable TORCH_DIST_INIT_BARRIER

    @liujch1998
    liujch1998 committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    d864fbc View commit details
    Browse the repository at this point in the history

  9. Inspecting barrier

    @liujch1998
    liujch1998 committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    3f6a552 View commit details
    Browse the repository at this point in the history

  10. Cleanup debugging stuff

    @liujch1998
    liujch1998 committed Oct 28, 2024
    Configuration menu
    Copy the full SHA
    7b71d42 View commit details
    Browse the repository at this point in the history

Commits on Nov 5, 2024

  1. Peteish curve fitting

    @liujch1998
    liujch1998 committed Nov 5, 2024
    Configuration menu
    Copy the full SHA
    a40ed1e View commit details
    Browse the repository at this point in the history

Commits on Nov 7, 2024

  1. simplify tasks

    @AkshitaB
    AkshitaB committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    4cd8bc1 View commit details
    Browse the repository at this point in the history

  2. fix lint

    @AkshitaB
    AkshitaB committed Nov 7, 2024
    Configuration menu
    Copy the full SHA
    030ab17 View commit details
    Browse the repository at this point in the history

Commits on Nov 11, 2024

  1. flops baseline

    @AkshitaB
    AkshitaB committed Nov 11, 2024
    Configuration menu
    Copy the full SHA
    163d3be View commit details
    Browse the repository at this point in the history

  2. flops script

    @AkshitaB
    AkshitaB committed Nov 11, 2024
    Configuration menu
    Copy the full SHA
    caad5c3 View commit details
    Browse the repository at this point in the history

  3. results for multiple tasks

    @AkshitaB
    AkshitaB committed Nov 11, 2024
    Configuration menu
    Copy the full SHA
    446107d View commit details
    Browse the repository at this point in the history

Commits on Nov 13, 2024

  1. stacked script

    @AkshitaB
    AkshitaB committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    b6169f3 View commit details
    Browse the repository at this point in the history

  2. refactor

    @AkshitaB
    AkshitaB committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    1b8959a View commit details
    Browse the repository at this point in the history

  3. add paper configs

    @AkshitaB
    AkshitaB committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    dca97a7 View commit details
    Browse the repository at this point in the history

  4. Massage for plotting

    @liujch1998
    liujch1998 committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    a21992b View commit details
    Browse the repository at this point in the history

  5. remove old code

    @AkshitaB
    AkshitaB committed Nov 13, 2024
    Configuration menu
    Copy the full SHA
    aa036e7 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2024

  1. Remove unused vera eval data

    @liujch1998
    liujch1998 committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    6e68283 View commit details
    Browse the repository at this point in the history

  2. Move things around a bit

    @liujch1998
    liujch1998 committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    f35a4b2 View commit details
    Browse the repository at this point in the history

  3. update

    @AkshitaB
    AkshitaB committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    15d6cea View commit details
    Browse the repository at this point in the history

  4. Merge branch 'main' into ladder-1xC

    @AkshitaB
    AkshitaB authored Nov 14, 2024
    Configuration menu
    Copy the full SHA
    c10deab View commit details
    Browse the repository at this point in the history

  5. variance analysis

    @AkshitaB
    AkshitaB committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    ce15bae View commit details
    Browse the repository at this point in the history

  6. fix

    @AkshitaB
    AkshitaB committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    7edf3ca View commit details
    Browse the repository at this point in the history

  7. bug fix

    @AkshitaB
    AkshitaB committed Nov 14, 2024
    Configuration menu
    Copy the full SHA
    662db73 View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2024

  1. Add a single-step prediction script

    @liujch1998
    liujch1998 committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    bad8674 View commit details
    Browse the repository at this point in the history

  2. Add a predict.py script that can predict for settings which we don't … 

    …have csv file
    @liujch1998
    liujch1998 committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    04eed46 View commit details
    Browse the repository at this point in the history

  3. Move amberish and older stuff into a deeper folder

    @liujch1998
    liujch1998 committed Nov 15, 2024
    Configuration menu
    Copy the full SHA
    ab97e87 View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2024

  1. Support predicting MC

    @liujch1998
    liujch1998 committed Nov 16, 2024
    Configuration menu
    Copy the full SHA
    0b4800a View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2024

  1. Predict for Peteish13

    @liujch1998
    liujch1998 committed Nov 17, 2024
    Configuration menu
    Copy the full SHA
    19ce054 View commit details
    Browse the repository at this point in the history

Commits on Nov 19, 2024

  1. Merge remote-tracking branch 'origin/main' into ladder-1xC

    @liujch1998
    liujch1998 committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    26f733d View commit details
    Browse the repository at this point in the history

  2. Update eval script (sync from backfill branch)

    @liujch1998
    liujch1998 committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    d7e0476 View commit details
    Browse the repository at this point in the history

  3. Lint things

    @liujch1998
    liujch1998 committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    b5327a0 View commit details
    Browse the repository at this point in the history

  4. Merge remote-tracking branch 'origin/main' into ladder-1xC

    @liujch1998
    liujch1998 committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    6e254d7 View commit details
    Browse the repository at this point in the history

  5. Add new evals to ladder

    @liujch1998
    liujch1998 committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    643c1ed View commit details
    Browse the repository at this point in the history

  6. Remove eval on train set

    @liujch1998
    liujch1998 committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    cb3e938 View commit details
    Browse the repository at this point in the history

  7. Make device_eval_batch_size an argument

    @liujch1998
    liujch1998 committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    8951dbb View commit details
    Browse the repository at this point in the history

  8. Remove MC and var evals

    @liujch1998
    liujch1998 committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    272ef4a View commit details
    Browse the repository at this point in the history

  9. merge

    @AkshitaB
    AkshitaB committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    9b80ad9 View commit details
    Browse the repository at this point in the history

  10. prediction interval bounds

    @AkshitaB
    AkshitaB committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    e5ebb23 View commit details
    Browse the repository at this point in the history

  11. separate functions

    @AkshitaB
    AkshitaB committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    6e3a1c2 View commit details
    Browse the repository at this point in the history

  12. flops analysis

    @AkshitaB
    AkshitaB committed Nov 19, 2024
    Configuration menu
    Copy the full SHA
    4cd12ef View commit details
    Browse the repository at this point in the history