Skip to content
This repository has been archived by the owner on Nov 1, 2024. It is now read-only.

convert_to_singleton doesn't seem to handle bias properly #689

Open
punitkoura opened this issue Mar 22, 2023 · 0 comments
Open

convert_to_singleton doesn't seem to handle bias properly #689

punitkoura opened this issue Mar 22, 2023 · 0 comments
Assignees
@andrewPoulton
Labels
bug Something isn't working

Comments

@punitkoura
Copy link
Contributor

  1. Take a 125m pretrained checkpoint.
  2. Consolidate the checkpoint using convert_to_singleton.py
  3. Try loading the model behind the metaseq API.

RuntimeError: Error(s) in loading state_dict for TransformerLanguageModel:
Missing key(s) in state_dict: "decoder.layers.0.fc2.bias", "decoder.layers.1.fc2.bias",
@punitkoura punitkoura added the bug Something isn't working label Mar 22, 2023
@andrewPoulton andrewPoulton mentioned this issue Mar 24, 2023
Open
@andrewPoulton andrewPoulton self-assigned this Apr 5, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@andrewPoulton andrewPoulton

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@punitkoura @andrewPoulton