Skip to content
This repository has been archived by the owner on Nov 1, 2024. It is now read-only.

Rewrite of the load_checkpoint function #650

Open
wants to merge 28 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
28 commits
Select commit Hold shift + click to select a range
e4a3a39
split out a get_checkpoint_path_to_load
suchenzang Nov 5, 2022
1f6071b
make restore_file optional, indent in trainer.load_checkpoint path ex…
suchenzang Nov 5, 2022
6ee9c4d
switch from default_restore_file string matching to is/not None checks
suchenzang Nov 5, 2022
c68d578
none guard
suchenzang Nov 5, 2022
a6fd478
sorting out restore_file logic
suchenzang Nov 5, 2022
0cf3c0c
merge main
Nov 22, 2022
18c6d16
make save_async a single command
Nov 24, 2022
570fced
remove duplicate flags
Nov 24, 2022
a9989aa
change naming to local_checkpoints_dir
Nov 25, 2022
6eefb06
finish core prepare_local_checkpoint_path function
Nov 29, 2022
a8b0613
black lint
Nov 29, 2022
6fe250c
add dataclass
Nov 29, 2022
2ddf1fb
remove old load function, add type hints, move out internal import
Nov 29, 2022
d46404a
changed naming of prio
Nov 29, 2022
725bfb8
change naming for epoch checkpoints to include num steps
Nov 29, 2022
5e6218e
add local caching by including num steps in cache file name
Nov 29, 2022
24b4ab8
move checkpoint path out
Jan 6, 2023
cec3941
only merge load_checkpoint related changes
Jan 16, 2023
243c327
add types and clean
Jan 20, 2023
d8c0e87
Merge branch 'main' into peter/rewrite_load_checkpoint
Feb 1, 2023
c3396b8
fixes
Feb 1, 2023
58dcfb2
two paths for local vs nfs checkpoints
Feb 6, 2023
65c03bc
add some debugging and load local checkpoints
Feb 10, 2023
e2efa2d
more cleanup, add reset_for_finetuning back in
Feb 10, 2023
cbff07c
run black .
Feb 14, 2023
9366295
Merge branch 'main' into peter/rewrite_load_checkpoint
Feb 14, 2023
0bde2fe
flake8
Feb 14, 2023
7991503
flake 8
Feb 14, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading