Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Robust Accuracy on Cifar10 #8

Open
SolidShen opened this issue Mar 19, 2020 · 1 comment
Open

Robust Accuracy on Cifar10 #8

SolidShen opened this issue Mar 19, 2020 · 1 comment

Comments

@SolidShen
Copy link

Dear authors:
In the paper (Table 7), you mentioned the robust accuracy on cifar10 for the standard training model is 4.49% (l2_bound = 0.25). Do you still use the same setting as you claimed in C.3 (7 steps with a step size of eps/5)? I am trying to reproduce your evaluation experiment but I can't achieve this accuracy on the same setting with the code from your lab released 'https://github.com/MadryLab/robustness'. (I can only get 11.3%) Could you provide more details about this experiment? Thanks!

@andrewilyas
Copy link
Contributor

For evaluating the robustness, you can use more steps to lower the accuracy (also, 11.3% vs 4.49% could just be due to differences in model training/architecture/etc, so I would not worry too much about this)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants