Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Some model parameters or buffers are not found in the checkpoint （FC-CLIP (ConvNeXt-Large)） #14

Open
gbliao opened this issue Nov 20, 2023 · 2 comments
Open

Some model parameters or buffers are not found in the checkpoint （FC-CLIP (ConvNeXt-Large)） #14

gbliao opened this issue Nov 20, 2023 · 2 comments

Comments

@gbliao
Copy link

gbliao commented Nov 20, 2023

Hi. When we use the FC-CLIP (ConvNeXt-Large) and the corresponding weight fcclip_cocopan.pth for evaluation, we encountered the following problem, may I ask how to solve it?

11/20 12:07:35 d2.checkpoint.detection_checkpoint]: [DetectionCheckpointer] Loading from fcclip_cocopan.pth ...
[11/20 12:07:35 fvcore.common.checkpoint]: [Checkpointer] Loading from fcclip_cocopan.pth ...
WARNING [11/20 12:07:35 fvcore.common.checkpoint]: Some model parameters or buffers are not found in the checkpoint:
backbone.clip_model.ln_final.{bias, weight}
backbone.clip_model.token_embedding.weight
backbone.clip_model.transformer.resblocks.0.attn.out_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.0.attn.{in_proj_bias, in_proj_weight}
backbone.clip_model.transformer.resblocks.0.ln_1.{bias, weight}
backbone.clip_model.transformer.resblocks.0.ln_2.{bias, weight}
backbone.clip_model.transformer.resblocks.0.mlp.c_fc.{bias, weight}
backbone.clip_model.transformer.resblocks.0.mlp.c_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.1.attn.out_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.1.attn.{in_proj_bias, in_proj_weight}
backbone.clip_model.transformer.resblocks.1.ln_1.{bias, weight}
backbone.clip_model.transformer.resblocks.1.ln_2.{bias, weight}
backbone.clip_model.transformer.resblocks.1.mlp.c_fc.{bias, weight}
backbone.clip_model.transformer.resblocks.1.mlp.c_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.10.attn.out_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.10.attn.{in_proj_bias, in_proj_weight}
backbone.clip_model.transformer.resblocks.10.ln_1.{bias, weight}
backbone.clip_model.transformer.resblocks.10.ln_2.{bias, weight}
backbone.clip_model.transformer.resblocks.10.mlp.c_fc.{bias, weight}
backbone.clip_model.transformer.resblocks.10.mlp.c_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.11.attn.out_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.11.attn.{in_proj_bias, in_proj_weight}
backbone.clip_model.transformer.resblocks.11.ln_1.{bias, weight}
backbone.clip_model.transformer.resblocks.11.ln_2.{bias, weight}
backbone.clip_model.transformer.resblocks.11.mlp.c_fc.{bias, weight}
backbone.clip_model.transformer.resblocks.11.mlp.c_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.12.attn.out_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.12.attn.{in_proj_bias, in_proj_weight}
backbone.clip_model.transformer.resblocks.12.ln_1.{bias, weight}
backbone.clip_model.transformer.resblocks.12.ln_2.{bias, weight}
backbone.clip_model.transformer.resblocks.12.mlp.c_fc.{bias, weight}
backbone.clip_model.transformer.resblocks.12.mlp.c_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.13.attn.out_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.13.attn.{in_proj_bias, in_proj_weight}
backbone.clip_model.transformer.resblocks.13.ln_1.{bias, weight}
backbone.clip_model.transformer.resblocks.13.ln_2.{bias, weight}
backbone.clip_model.transformer.resblocks.13.mlp.c_fc.{bias, weight}
backbone.clip_model.transformer.resblocks.13.mlp.c_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.14.attn.out_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.14.attn.{in_proj_bias, in_proj_weight}
backbone.clip_model.transformer.resblocks.14.ln_1.{bias, weight}
backbone.clip_model.transformer.resblocks.14.ln_2.{bias, weight}
backbone.clip_model.transformer.resblocks.14.mlp.c_fc.{bias, weight}
backbone.clip_model.transformer.resblocks.14.mlp.c_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.15.attn.out_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.15.attn.{in_proj_bias, in_proj_weight}
backbone.clip_model.transformer.resblocks.15.ln_1.{bias, weight}
backbone.clip_model.transformer.resblocks.15.ln_2.{bias, weight}
backbone.clip_model.transformer.resblocks.15.mlp.c_fc.{bias, weight}
backbone.clip_model.transformer.resblocks.15.mlp.c_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.2.attn.out_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.2.attn.{in_proj_bias, in_proj_weight}
backbone.clip_model.transformer.resblocks.2.ln_1.{bias, weight}
backbone.clip_model.transformer.resblocks.2.ln_2.{bias, weight}
backbone.clip_model.transformer.resblocks.2.mlp.c_fc.{bias, weight}
backbone.clip_model.transformer.resblocks.2.mlp.c_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.3.attn.out_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.3.attn.{in_proj_bias, in_proj_weight}
backbone.clip_model.transformer.resblocks.3.ln_1.{bias, weight}
backbone.clip_model.transformer.resblocks.3.ln_2.{bias, weight}
backbone.clip_model.transformer.resblocks.3.mlp.c_fc.{bias, weight}
backbone.clip_model.transformer.resblocks.3.mlp.c_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.4.attn.out_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.4.attn.{in_proj_bias, in_proj_weight}
backbone.clip_model.transformer.resblocks.4.ln_1.{bias, weight}
backbone.clip_model.transformer.resblocks.4.ln_2.{bias, weight}
backbone.clip_model.transformer.resblocks.4.mlp.c_fc.{bias, weight}
backbone.clip_model.transformer.resblocks.4.mlp.c_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.5.attn.out_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.5.attn.{in_proj_bias, in_proj_weight}
backbone.clip_model.transformer.resblocks.5.ln_1.{bias, weight}
backbone.clip_model.transformer.resblocks.5.ln_2.{bias, weight}
backbone.clip_model.transformer.resblocks.5.mlp.c_fc.{bias, weight}
backbone.clip_model.transformer.resblocks.5.mlp.c_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.6.attn.out_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.6.attn.{in_proj_bias, in_proj_weight}
backbone.clip_model.transformer.resblocks.6.ln_1.{bias, weight}
backbone.clip_model.transformer.resblocks.6.ln_2.{bias, weight}
backbone.clip_model.transformer.resblocks.6.mlp.c_fc.{bias, weight}
backbone.clip_model.transformer.resblocks.6.mlp.c_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.7.attn.out_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.7.attn.{in_proj_bias, in_proj_weight}
backbone.clip_model.transformer.resblocks.7.ln_1.{bias, weight}
backbone.clip_model.transformer.resblocks.7.ln_2.{bias, weight}
backbone.clip_model.transformer.resblocks.7.mlp.c_fc.{bias, weight}
backbone.clip_model.transformer.resblocks.7.mlp.c_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.8.attn.out_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.8.attn.{in_proj_bias, in_proj_weight}
backbone.clip_model.transformer.resblocks.8.ln_1.{bias, weight}
backbone.clip_model.transformer.resblocks.8.ln_2.{bias, weight}
backbone.clip_model.transformer.resblocks.8.mlp.c_fc.{bias, weight}
backbone.clip_model.transformer.resblocks.8.mlp.c_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.9.attn.out_proj.{bias, weight}
backbone.clip_model.transformer.resblocks.9.attn.{in_proj_bias, in_proj_weight}
backbone.clip_model.transformer.resblocks.9.ln_1.{bias, weight}
backbone.clip_model.transformer.resblocks.9.ln_2.{bias, weight}
backbone.clip_model.transformer.resblocks.9.mlp.c_fc.{bias, weight}
backbone.clip_model.transformer.resblocks.9.mlp.c_proj.{bias, weight}
backbone.clip_model.visual.head.mlp.fc1.{bias, weight}
backbone.clip_model.visual.head.mlp.fc2.weight
backbone.clip_model.visual.trunk.head.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.0.blocks.0.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.0.blocks.0.gamma
backbone.clip_model.visual.trunk.stages.0.blocks.0.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.0.blocks.0.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.0.blocks.0.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.0.blocks.1.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.0.blocks.1.gamma
backbone.clip_model.visual.trunk.stages.0.blocks.1.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.0.blocks.1.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.0.blocks.1.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.0.blocks.2.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.0.blocks.2.gamma
backbone.clip_model.visual.trunk.stages.0.blocks.2.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.0.blocks.2.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.0.blocks.2.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.1.blocks.0.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.1.blocks.0.gamma
backbone.clip_model.visual.trunk.stages.1.blocks.0.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.1.blocks.0.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.1.blocks.0.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.1.blocks.1.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.1.blocks.1.gamma
backbone.clip_model.visual.trunk.stages.1.blocks.1.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.1.blocks.1.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.1.blocks.1.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.1.blocks.2.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.1.blocks.2.gamma
backbone.clip_model.visual.trunk.stages.1.blocks.2.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.1.blocks.2.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.1.blocks.2.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.1.downsample.0.{bias, weight}
backbone.clip_model.visual.trunk.stages.1.downsample.1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.0.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.0.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.0.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.0.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.0.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.1.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.1.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.1.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.1.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.1.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.10.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.10.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.10.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.10.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.10.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.11.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.11.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.11.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.11.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.11.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.12.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.12.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.12.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.12.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.12.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.13.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.13.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.13.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.13.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.13.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.14.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.14.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.14.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.14.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.14.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.15.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.15.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.15.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.15.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.15.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.16.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.16.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.16.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.16.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.16.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.17.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.17.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.17.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.17.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.17.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.18.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.18.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.18.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.18.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.18.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.19.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.19.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.19.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.19.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.19.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.2.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.2.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.2.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.2.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.2.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.20.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.20.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.20.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.20.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.20.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.21.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.21.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.21.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.21.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.21.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.22.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.22.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.22.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.22.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.22.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.23.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.23.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.23.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.23.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.23.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.24.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.24.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.24.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.24.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.24.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.25.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.25.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.25.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.25.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.25.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.26.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.26.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.26.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.26.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.26.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.3.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.3.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.3.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.3.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.3.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.4.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.4.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.4.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.4.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.4.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.5.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.5.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.5.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.5.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.5.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.6.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.6.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.6.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.6.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.6.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.7.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.7.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.7.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.7.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.7.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.8.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.8.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.8.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.8.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.8.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.9.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.9.gamma
backbone.clip_model.visual.trunk.stages.2.blocks.9.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.9.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.blocks.9.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.downsample.0.{bias, weight}
backbone.clip_model.visual.trunk.stages.2.downsample.1.{bias, weight}
backbone.clip_model.visual.trunk.stages.3.blocks.0.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.3.blocks.0.gamma
backbone.clip_model.visual.trunk.stages.3.blocks.0.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.3.blocks.0.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.3.blocks.0.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.3.blocks.1.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.3.blocks.1.gamma
backbone.clip_model.visual.trunk.stages.3.blocks.1.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.3.blocks.1.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.3.blocks.1.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.3.blocks.2.conv_dw.{bias, weight}
backbone.clip_model.visual.trunk.stages.3.blocks.2.gamma
backbone.clip_model.visual.trunk.stages.3.blocks.2.mlp.fc1.{bias, weight}
backbone.clip_model.visual.trunk.stages.3.blocks.2.mlp.fc2.{bias, weight}
backbone.clip_model.visual.trunk.stages.3.blocks.2.norm.{bias, weight}
backbone.clip_model.visual.trunk.stages.3.downsample.0.{bias, weight}
backbone.clip_model.visual.trunk.stages.3.downsample.1.{bias, weight}
backbone.clip_model.visual.trunk.stem.0.{bias, weight}
backbone.clip_model.visual.trunk.stem.1.{bias, weight}
backbone.clip_model.{logit_scale, positional_embedding, text_projection}
@cornettoyu
Copy link
Collaborator

Hi,

The missing parameters are in the frozen CNN CLIP part, which should be loaded from the pre-trained weights from OpenCLIP. That's why the provided checkpoint does not contain them and raise the warning. But it should be fine and you should have the same results.

Best,

@gbliao
Copy link
Author

gbliao commented Nov 21, 2023

Thank you for your timely reply！

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@gbliao @cornettoyu