Skip to content

HF2UCP: Converting a pytorch_model.bin or .safetensors checkpoint to UCP #7212

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 11 commits into
base: master
Choose a base branch
from
Open

HF2UCP: Converting a pytorch_model.bin or .safetensors checkpoint to UCP #7212

wants to merge 11 commits into from

Conversation

Schwidola0607
Copy link

@Schwidola0607 Schwidola0607 commented Apr 10, 2025 •
edited
Loading

PR for HF2UCP feature

Converting a pytorch_model.bin or .safetensors checkpoint to UCP will

  • zero initialize optimizer states (exp_avg_sq.pt and exp_avg.pt)
  • skip over copying _model_states.pt and optimizer_state.pt files as those are not available to a HF checkpoint

Schwidola0607 and others added 5 commits April 10, 2025 05:08
@Schwidola0607
add support for HF2UCP feature
0e1ea4c 
Signed-off-by: Schwidola0607 <[email protected]>
@Schwidola0607
add user guide
727206e 
Signed-off-by: Schwidola0607 <[email protected]>
@Schwidola0607
edit user guide
49588a8 
Signed-off-by: Schwidola0607 <[email protected]>
@Schwidola0607
cleaning up
7bef517 
Signed-off-by: Schwidola0607 <[email protected]>
@xylian86 @Schwidola0607
nits
2930f2a 
Signed-off-by: Schwidola0607 <[email protected]>
@Schwidola0607 Schwidola0607 marked this pull request as ready for review April 13, 2025 08:34
Schwidola0607 and others added 4 commits April 15, 2025 03:34
@Schwidola0607
remove ignore_missing_optim config from zero ds_config
9207df9 
Signed-off-by: Schwidola0607 <[email protected]>
@Schwidola0607
fix to make ucp load more lenient
8090369 
Signed-off-by: Schwidola0607 <[email protected]>
@xylian86 @Schwidola0607
nits
7b8962a 
Signed-off-by: Schwidola0607 <[email protected]>
@xylian86 @Schwidola0607
nits
2389567 
Signed-off-by: Schwidola0607 <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@tjruwase tjruwase Awaiting requested review from tjruwase tjruwase is a code owner

@tohtana tohtana Awaiting requested review from tohtana tohtana is a code owner

@loadams loadams Awaiting requested review from loadams loadams is a code owner

At least 1 approving review is required to merge this pull request.

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@Schwidola0607 @xylian86 @loadams