Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Training from scratch reached the performance similar with that when initializing from ImageNet #68

Open
Shawn207 opened this issue May 2, 2022 · 1 comment

Comments

@Shawn207
Copy link

Shawn207 commented May 2, 2022

Hi there,
I was trying to reproduce the results reported here on PSPNet-Resnet18.
I actually trained it from stratch( --is_student_load_imgnet = False, and empty in ./ckpt/save_path/Student), so student is not loaded with any weights, but I achieved 70% acc with batch_size = 7, which is even a bit smaller than original setting. When I tried with 6000 steps, the acc is 72.7%. The behavior is actually similar with what is reported when initializing with pretrained imagenet model. Do you have any idea on that?
Thanks !

@AiladReb
Copy link

@Shawn207 Could you please tell me how did you train the teacher ?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants