-
Notifications
You must be signed in to change notification settings - Fork 18
/
train_erm.log
2164 lines (2164 loc) · 188 KB
/
train_erm.log
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
nohup: ignoring input
INFO:root:start with arguments Namespace(batch_size=128, benchmark=0, data_nthreads=4, data_train='data/cifar10_train.rec', data_train_idx='', data_val='data/cifar10_val.rec', data_val_idx='', disp_batches=20, dtype='float32', gpus='0,1', image_shape='3,28,28', kv_store='device', load_epoch=None, lr=0.05, lr_factor=0.1, lr_step_epochs='200,250', max_random_aspect_ratio=0, max_random_h=36, max_random_l=50, max_random_rotate_angle=0, max_random_s=50, max_random_scale=1, max_random_shear_ratio=0, min_random_scale=1, model_prefix=None, mom=0.9, monitor=0, network='resnet', num_classes=10, num_epochs=90, num_examples=50000, num_layers=50, optimizer='sgd', pad_size=4, random_crop=1, random_mirror=1, rgb_mean='123.68,116.779,103.939', test_io=0, top_k=0, wd=0.0001)
[06:16:06] src/io/iter_image_recordio_2.cc:169: ImageRecordIOParser2: data/cifar10_train.rec, use 4 threads for decoding..
[06:16:06] src/io/iter_image_recordio_2.cc:169: ImageRecordIOParser2: data/cifar10_val.rec, use 4 threads for decoding..
[06:16:07] src/operator/././cudnn_algoreg-inl.h:106: Running performance tests to find the best convolution algorithm, this can take a while... (setting env variable MXNET_CUDNN_AUTOTUNE_DEFAULT to 0 to disable)
INFO:root:Epoch[0] Batch [20] Speed: 4199.45 samples/sec accuracy=0.146205 cross-entropy=2.272440
INFO:root:Epoch[0] Batch [40] Speed: 4472.69 samples/sec accuracy=0.225391 cross-entropy=2.038481
INFO:root:Epoch[0] Batch [60] Speed: 4432.20 samples/sec accuracy=0.262109 cross-entropy=1.977143
INFO:root:Epoch[0] Batch [80] Speed: 4420.15 samples/sec accuracy=0.275391 cross-entropy=1.928166
INFO:root:Epoch[0] Batch [100] Speed: 4395.79 samples/sec accuracy=0.295703 cross-entropy=1.866777
INFO:root:Epoch[0] Batch [120] Speed: 4368.68 samples/sec accuracy=0.311719 cross-entropy=1.829836
INFO:root:Epoch[0] Batch [140] Speed: 4377.76 samples/sec accuracy=0.328516 cross-entropy=1.795280
INFO:root:Epoch[0] Batch [160] Speed: 4400.87 samples/sec accuracy=0.323437 cross-entropy=1.791154
INFO:root:Epoch[0] Batch [180] Speed: 4388.15 samples/sec accuracy=0.349219 cross-entropy=1.751985
INFO:root:Epoch[0] Batch [200] Speed: 4439.84 samples/sec accuracy=0.347656 cross-entropy=1.735669
INFO:root:Epoch[0] Batch [220] Speed: 4362.47 samples/sec accuracy=0.371875 cross-entropy=1.692542
INFO:root:Epoch[0] Batch [240] Speed: 4366.51 samples/sec accuracy=0.382812 cross-entropy=1.657716
INFO:root:Epoch[0] Batch [260] Speed: 4434.48 samples/sec accuracy=0.401172 cross-entropy=1.623592
INFO:root:Epoch[0] Batch [280] Speed: 4449.19 samples/sec accuracy=0.411719 cross-entropy=1.603604
INFO:root:Epoch[0] Batch [300] Speed: 4423.05 samples/sec accuracy=0.437500 cross-entropy=1.569692
INFO:root:Epoch[0] Batch [320] Speed: 4440.30 samples/sec accuracy=0.435156 cross-entropy=1.549425
INFO:root:Epoch[0] Batch [340] Speed: 4393.77 samples/sec accuracy=0.468750 cross-entropy=1.471245
INFO:root:Epoch[0] Batch [360] Speed: 4253.25 samples/sec accuracy=0.474219 cross-entropy=1.488943
INFO:root:Epoch[0] Batch [380] Speed: 4366.14 samples/sec accuracy=0.471094 cross-entropy=1.458921
INFO:root:Epoch[0] Train-accuracy=0.500000
INFO:root:Epoch[0] Train-cross-entropy=1.427537
INFO:root:Epoch[0] Time cost=11.808
INFO:root:Epoch[0] Validation-accuracy=0.521756
INFO:root:Epoch[0] Validation-cross-entropy=1.314588
INFO:root:Epoch[1] Batch [20] Speed: 4459.49 samples/sec accuracy=0.503348 cross-entropy=1.376545
INFO:root:Epoch[1] Batch [40] Speed: 4167.02 samples/sec accuracy=0.497656 cross-entropy=1.412856
INFO:root:Epoch[1] Batch [60] Speed: 4279.81 samples/sec accuracy=0.491016 cross-entropy=1.383806
INFO:root:Epoch[1] Batch [80] Speed: 4395.04 samples/sec accuracy=0.512500 cross-entropy=1.386951
INFO:root:Epoch[1] Batch [100] Speed: 4432.00 samples/sec accuracy=0.524219 cross-entropy=1.313305
INFO:root:Epoch[1] Batch [120] Speed: 4433.58 samples/sec accuracy=0.511328 cross-entropy=1.326033
INFO:root:Epoch[1] Batch [140] Speed: 4417.53 samples/sec accuracy=0.532031 cross-entropy=1.300091
INFO:root:Epoch[1] Batch [160] Speed: 4448.60 samples/sec accuracy=0.547266 cross-entropy=1.264700
INFO:root:Epoch[1] Batch [180] Speed: 4369.88 samples/sec accuracy=0.557813 cross-entropy=1.229768
INFO:root:Epoch[1] Batch [200] Speed: 4438.19 samples/sec accuracy=0.539453 cross-entropy=1.313149
INFO:root:Epoch[1] Batch [220] Speed: 4483.49 samples/sec accuracy=0.559375 cross-entropy=1.259425
INFO:root:Epoch[1] Batch [240] Speed: 4381.87 samples/sec accuracy=0.549219 cross-entropy=1.257326
INFO:root:Epoch[1] Batch [260] Speed: 4384.94 samples/sec accuracy=0.556250 cross-entropy=1.260112
INFO:root:Epoch[1] Batch [280] Speed: 4333.78 samples/sec accuracy=0.574219 cross-entropy=1.191832
INFO:root:Epoch[1] Batch [300] Speed: 4415.76 samples/sec accuracy=0.568750 cross-entropy=1.212199
INFO:root:Epoch[1] Batch [320] Speed: 4504.24 samples/sec accuracy=0.579688 cross-entropy=1.185971
INFO:root:Epoch[1] Batch [340] Speed: 4427.63 samples/sec accuracy=0.580078 cross-entropy=1.174482
INFO:root:Epoch[1] Batch [360] Speed: 4448.05 samples/sec accuracy=0.587109 cross-entropy=1.151152
INFO:root:Epoch[1] Batch [380] Speed: 4260.28 samples/sec accuracy=0.585938 cross-entropy=1.165908
INFO:root:Epoch[1] Train-accuracy=0.574219
INFO:root:Epoch[1] Train-cross-entropy=1.209713
INFO:root:Epoch[1] Time cost=11.416
INFO:root:Epoch[1] Validation-accuracy=0.616386
INFO:root:Epoch[1] Validation-cross-entropy=1.089116
INFO:root:Epoch[2] Batch [20] Speed: 4360.52 samples/sec accuracy=0.599702 cross-entropy=1.128695
INFO:root:Epoch[2] Batch [40] Speed: 4305.61 samples/sec accuracy=0.599609 cross-entropy=1.127239
INFO:root:Epoch[2] Batch [60] Speed: 4266.01 samples/sec accuracy=0.595703 cross-entropy=1.135353
INFO:root:Epoch[2] Batch [80] Speed: 4381.97 samples/sec accuracy=0.600391 cross-entropy=1.132396
INFO:root:Epoch[2] Batch [100] Speed: 4344.01 samples/sec accuracy=0.621875 cross-entropy=1.063545
INFO:root:Epoch[2] Batch [120] Speed: 4467.81 samples/sec accuracy=0.610156 cross-entropy=1.102443
INFO:root:Epoch[2] Batch [140] Speed: 4451.04 samples/sec accuracy=0.611719 cross-entropy=1.077759
INFO:root:Epoch[2] Batch [160] Speed: 4395.90 samples/sec accuracy=0.622656 cross-entropy=1.044338
INFO:root:Epoch[2] Batch [180] Speed: 4453.30 samples/sec accuracy=0.627734 cross-entropy=1.025753
INFO:root:Epoch[2] Batch [200] Speed: 4357.43 samples/sec accuracy=0.630469 cross-entropy=1.053706
INFO:root:Epoch[2] Batch [220] Speed: 4458.41 samples/sec accuracy=0.628906 cross-entropy=1.048701
INFO:root:Epoch[2] Batch [240] Speed: 4373.76 samples/sec accuracy=0.632422 cross-entropy=1.032798
INFO:root:Epoch[2] Batch [260] Speed: 4443.28 samples/sec accuracy=0.620313 cross-entropy=1.035397
INFO:root:Epoch[2] Batch [280] Speed: 4449.77 samples/sec accuracy=0.646094 cross-entropy=1.001531
INFO:root:Epoch[2] Batch [300] Speed: 4412.46 samples/sec accuracy=0.634375 cross-entropy=1.036068
INFO:root:Epoch[2] Batch [320] Speed: 4343.81 samples/sec accuracy=0.651563 cross-entropy=0.983069
INFO:root:Epoch[2] Batch [340] Speed: 4446.09 samples/sec accuracy=0.646875 cross-entropy=1.008715
INFO:root:Epoch[2] Batch [360] Speed: 4410.15 samples/sec accuracy=0.646484 cross-entropy=0.989538
INFO:root:Epoch[2] Batch [380] Speed: 4401.69 samples/sec accuracy=0.660156 cross-entropy=0.967864
INFO:root:Epoch[2] Train-accuracy=0.643229
INFO:root:Epoch[2] Train-cross-entropy=0.996289
INFO:root:Epoch[2] Time cost=11.353
INFO:root:Epoch[2] Validation-accuracy=0.677083
INFO:root:Epoch[2] Validation-cross-entropy=0.922771
INFO:root:Epoch[3] Batch [20] Speed: 4376.54 samples/sec accuracy=0.678571 cross-entropy=0.941009
INFO:root:Epoch[3] Batch [40] Speed: 4389.42 samples/sec accuracy=0.658984 cross-entropy=0.964352
INFO:root:Epoch[3] Batch [60] Speed: 4381.69 samples/sec accuracy=0.662109 cross-entropy=0.966800
INFO:root:Epoch[3] Batch [80] Speed: 4328.13 samples/sec accuracy=0.678125 cross-entropy=0.962819
INFO:root:Epoch[3] Batch [100] Speed: 4305.37 samples/sec accuracy=0.667969 cross-entropy=0.966618
INFO:root:Epoch[3] Batch [120] Speed: 4344.56 samples/sec accuracy=0.680078 cross-entropy=0.916395
INFO:root:Epoch[3] Batch [140] Speed: 4339.37 samples/sec accuracy=0.678125 cross-entropy=0.906165
INFO:root:Epoch[3] Batch [160] Speed: 4477.18 samples/sec accuracy=0.670703 cross-entropy=0.942592
INFO:root:Epoch[3] Batch [180] Speed: 4369.70 samples/sec accuracy=0.670312 cross-entropy=0.942753
INFO:root:Epoch[3] Batch [200] Speed: 4397.34 samples/sec accuracy=0.681641 cross-entropy=0.939097
INFO:root:Epoch[3] Batch [220] Speed: 4303.86 samples/sec accuracy=0.685156 cross-entropy=0.906526
INFO:root:Epoch[3] Batch [240] Speed: 4319.17 samples/sec accuracy=0.685937 cross-entropy=0.898376
INFO:root:Epoch[3] Batch [260] Speed: 4207.89 samples/sec accuracy=0.691406 cross-entropy=0.901888
INFO:root:Epoch[3] Batch [280] Speed: 4441.82 samples/sec accuracy=0.692187 cross-entropy=0.870573
INFO:root:Epoch[3] Batch [300] Speed: 4420.61 samples/sec accuracy=0.699219 cross-entropy=0.888892
INFO:root:Epoch[3] Batch [320] Speed: 4290.18 samples/sec accuracy=0.702734 cross-entropy=0.866101
INFO:root:Epoch[3] Batch [340] Speed: 4380.76 samples/sec accuracy=0.698828 cross-entropy=0.866469
INFO:root:Epoch[3] Batch [360] Speed: 4248.84 samples/sec accuracy=0.685547 cross-entropy=0.883113
INFO:root:Epoch[3] Batch [380] Speed: 4491.92 samples/sec accuracy=0.694922 cross-entropy=0.872450
INFO:root:Epoch[3] Train-accuracy=0.699219
INFO:root:Epoch[3] Train-cross-entropy=0.840657
INFO:root:Epoch[3] Time cost=11.475
INFO:root:Epoch[3] Validation-accuracy=0.728065
INFO:root:Epoch[3] Validation-cross-entropy=0.785924
INFO:root:Epoch[4] Batch [20] Speed: 4456.04 samples/sec accuracy=0.699777 cross-entropy=0.866304
INFO:root:Epoch[4] Batch [40] Speed: 4381.60 samples/sec accuracy=0.685937 cross-entropy=0.879759
INFO:root:Epoch[4] Batch [60] Speed: 4498.32 samples/sec accuracy=0.694531 cross-entropy=0.878369
INFO:root:Epoch[4] Batch [80] Speed: 4399.06 samples/sec accuracy=0.713281 cross-entropy=0.827637
INFO:root:Epoch[4] Batch [100] Speed: 4350.14 samples/sec accuracy=0.714063 cross-entropy=0.838980
INFO:root:Epoch[4] Batch [120] Speed: 4187.32 samples/sec accuracy=0.705078 cross-entropy=0.848193
INFO:root:Epoch[4] Batch [140] Speed: 4221.47 samples/sec accuracy=0.724609 cross-entropy=0.820949
INFO:root:Epoch[4] Batch [160] Speed: 4278.99 samples/sec accuracy=0.717187 cross-entropy=0.816589
INFO:root:Epoch[4] Batch [180] Speed: 4411.79 samples/sec accuracy=0.696094 cross-entropy=0.864978
INFO:root:Epoch[4] Batch [200] Speed: 4418.29 samples/sec accuracy=0.707812 cross-entropy=0.872761
INFO:root:Epoch[4] Batch [220] Speed: 4393.63 samples/sec accuracy=0.702344 cross-entropy=0.848276
INFO:root:Epoch[4] Batch [240] Speed: 4310.74 samples/sec accuracy=0.724609 cross-entropy=0.794031
INFO:root:Epoch[4] Batch [260] Speed: 4208.48 samples/sec accuracy=0.692969 cross-entropy=0.844262
INFO:root:Epoch[4] Batch [280] Speed: 4392.42 samples/sec accuracy=0.708984 cross-entropy=0.834644
INFO:root:Epoch[4] Batch [300] Speed: 4356.06 samples/sec accuracy=0.722266 cross-entropy=0.801925
INFO:root:Epoch[4] Batch [320] Speed: 4425.52 samples/sec accuracy=0.720703 cross-entropy=0.810416
INFO:root:Epoch[4] Batch [340] Speed: 4288.14 samples/sec accuracy=0.737891 cross-entropy=0.772127
INFO:root:Epoch[4] Batch [360] Speed: 4359.43 samples/sec accuracy=0.722266 cross-entropy=0.814033
INFO:root:Epoch[4] Batch [380] Speed: 4314.01 samples/sec accuracy=0.721094 cross-entropy=0.798504
INFO:root:Epoch[4] Train-accuracy=0.720313
INFO:root:Epoch[4] Train-cross-entropy=0.787839
INFO:root:Epoch[4] Time cost=11.498
INFO:root:Epoch[4] Validation-accuracy=0.748097
INFO:root:Epoch[4] Validation-cross-entropy=0.733485
INFO:root:Epoch[5] Batch [20] Speed: 4380.76 samples/sec accuracy=0.730283 cross-entropy=0.779911
INFO:root:Epoch[5] Batch [40] Speed: 4389.85 samples/sec accuracy=0.728906 cross-entropy=0.788205
INFO:root:Epoch[5] Batch [60] Speed: 4210.67 samples/sec accuracy=0.723828 cross-entropy=0.801630
INFO:root:Epoch[5] Batch [80] Speed: 4423.73 samples/sec accuracy=0.718359 cross-entropy=0.823471
INFO:root:Epoch[5] Batch [100] Speed: 4435.46 samples/sec accuracy=0.734766 cross-entropy=0.797659
INFO:root:Epoch[5] Batch [120] Speed: 4401.67 samples/sec accuracy=0.728125 cross-entropy=0.782885
INFO:root:Epoch[5] Batch [140] Speed: 4344.02 samples/sec accuracy=0.735156 cross-entropy=0.769690
INFO:root:Epoch[5] Batch [160] Speed: 4431.08 samples/sec accuracy=0.731641 cross-entropy=0.749287
INFO:root:Epoch[5] Batch [180] Speed: 4402.56 samples/sec accuracy=0.735938 cross-entropy=0.769383
INFO:root:Epoch[5] Batch [200] Speed: 4248.58 samples/sec accuracy=0.715234 cross-entropy=0.808777
INFO:root:Epoch[5] Batch [220] Speed: 4297.69 samples/sec accuracy=0.749609 cross-entropy=0.729785
INFO:root:Epoch[5] Batch [240] Speed: 4222.50 samples/sec accuracy=0.738281 cross-entropy=0.768067
INFO:root:Epoch[5] Batch [260] Speed: 4372.49 samples/sec accuracy=0.732031 cross-entropy=0.759133
INFO:root:Epoch[5] Batch [280] Speed: 4331.01 samples/sec accuracy=0.722266 cross-entropy=0.764326
INFO:root:Epoch[5] Batch [300] Speed: 4238.49 samples/sec accuracy=0.741016 cross-entropy=0.761715
INFO:root:Epoch[5] Batch [320] Speed: 4339.45 samples/sec accuracy=0.735547 cross-entropy=0.751636
INFO:root:Epoch[5] Batch [340] Speed: 4365.04 samples/sec accuracy=0.750781 cross-entropy=0.719562
INFO:root:Epoch[5] Batch [360] Speed: 4272.75 samples/sec accuracy=0.729688 cross-entropy=0.763763
INFO:root:Epoch[5] Batch [380] Speed: 4286.66 samples/sec accuracy=0.737500 cross-entropy=0.740749
INFO:root:Epoch[5] Train-accuracy=0.736979
INFO:root:Epoch[5] Train-cross-entropy=0.764707
INFO:root:Epoch[5] Time cost=11.523
INFO:root:Epoch[5] Validation-accuracy=0.770933
INFO:root:Epoch[5] Validation-cross-entropy=0.652542
INFO:root:Epoch[6] Batch [20] Speed: 4078.34 samples/sec accuracy=0.735863 cross-entropy=0.745445
INFO:root:Epoch[6] Batch [40] Speed: 4044.67 samples/sec accuracy=0.758984 cross-entropy=0.733802
INFO:root:Epoch[6] Batch [60] Speed: 4342.71 samples/sec accuracy=0.753516 cross-entropy=0.729810
INFO:root:Epoch[6] Batch [80] Speed: 4337.39 samples/sec accuracy=0.761719 cross-entropy=0.706375
INFO:root:Epoch[6] Batch [100] Speed: 4296.64 samples/sec accuracy=0.753516 cross-entropy=0.714554
INFO:root:Epoch[6] Batch [120] Speed: 4361.25 samples/sec accuracy=0.750781 cross-entropy=0.706263
INFO:root:Epoch[6] Batch [140] Speed: 4340.47 samples/sec accuracy=0.743359 cross-entropy=0.719207
INFO:root:Epoch[6] Batch [160] Speed: 4354.05 samples/sec accuracy=0.731250 cross-entropy=0.736002
INFO:root:Epoch[6] Batch [180] Speed: 4212.52 samples/sec accuracy=0.750000 cross-entropy=0.733985
INFO:root:Epoch[6] Batch [200] Speed: 4246.62 samples/sec accuracy=0.736719 cross-entropy=0.756510
INFO:root:Epoch[6] Batch [220] Speed: 4309.04 samples/sec accuracy=0.750781 cross-entropy=0.724897
INFO:root:Epoch[6] Batch [240] Speed: 4207.06 samples/sec accuracy=0.747656 cross-entropy=0.713599
INFO:root:Epoch[6] Batch [260] Speed: 4163.68 samples/sec accuracy=0.751172 cross-entropy=0.699043
INFO:root:Epoch[6] Batch [280] Speed: 4420.59 samples/sec accuracy=0.734375 cross-entropy=0.737162
INFO:root:Epoch[6] Batch [300] Speed: 4353.44 samples/sec accuracy=0.751172 cross-entropy=0.697885
INFO:root:Epoch[6] Batch [320] Speed: 4253.51 samples/sec accuracy=0.756250 cross-entropy=0.716651
INFO:root:Epoch[6] Batch [340] Speed: 4340.83 samples/sec accuracy=0.757812 cross-entropy=0.708001
INFO:root:Epoch[6] Batch [360] Speed: 4455.17 samples/sec accuracy=0.766406 cross-entropy=0.674301
INFO:root:Epoch[6] Batch [380] Speed: 4269.76 samples/sec accuracy=0.753906 cross-entropy=0.702673
INFO:root:Epoch[6] Train-accuracy=0.743750
INFO:root:Epoch[6] Train-cross-entropy=0.752768
INFO:root:Epoch[6] Time cost=11.681
INFO:root:Epoch[6] Validation-accuracy=0.779347
INFO:root:Epoch[6] Validation-cross-entropy=0.634653
INFO:root:Epoch[7] Batch [20] Speed: 4382.04 samples/sec accuracy=0.767113 cross-entropy=0.674411
INFO:root:Epoch[7] Batch [40] Speed: 4350.19 samples/sec accuracy=0.755859 cross-entropy=0.711719
INFO:root:Epoch[7] Batch [60] Speed: 4355.99 samples/sec accuracy=0.756641 cross-entropy=0.715806
INFO:root:Epoch[7] Batch [80] Speed: 4334.28 samples/sec accuracy=0.758203 cross-entropy=0.714119
INFO:root:Epoch[7] Batch [100] Speed: 4354.21 samples/sec accuracy=0.770703 cross-entropy=0.669813
INFO:root:Epoch[7] Batch [120] Speed: 4223.17 samples/sec accuracy=0.762891 cross-entropy=0.692545
INFO:root:Epoch[7] Batch [140] Speed: 4452.37 samples/sec accuracy=0.764062 cross-entropy=0.668224
INFO:root:Epoch[7] Batch [160] Speed: 4393.54 samples/sec accuracy=0.766797 cross-entropy=0.680626
INFO:root:Epoch[7] Batch [180] Speed: 4329.96 samples/sec accuracy=0.760547 cross-entropy=0.684900
INFO:root:Epoch[7] Batch [200] Speed: 4284.77 samples/sec accuracy=0.752734 cross-entropy=0.718078
INFO:root:Epoch[7] Batch [220] Speed: 4280.79 samples/sec accuracy=0.769141 cross-entropy=0.675938
INFO:root:Epoch[7] Batch [240] Speed: 4257.65 samples/sec accuracy=0.763281 cross-entropy=0.670126
INFO:root:Epoch[7] Batch [260] Speed: 4345.75 samples/sec accuracy=0.769531 cross-entropy=0.679086
INFO:root:Epoch[7] Batch [280] Speed: 4360.47 samples/sec accuracy=0.758594 cross-entropy=0.676475
INFO:root:Epoch[7] Batch [300] Speed: 4373.34 samples/sec accuracy=0.766797 cross-entropy=0.668506
INFO:root:Epoch[7] Batch [320] Speed: 4416.12 samples/sec accuracy=0.766406 cross-entropy=0.682373
INFO:root:Epoch[7] Batch [340] Speed: 4301.66 samples/sec accuracy=0.766797 cross-entropy=0.657826
INFO:root:Epoch[7] Batch [360] Speed: 4302.09 samples/sec accuracy=0.778516 cross-entropy=0.633833
INFO:root:Epoch[7] Batch [380] Speed: 4181.18 samples/sec accuracy=0.748437 cross-entropy=0.711380
INFO:root:Epoch[7] Train-accuracy=0.763021
INFO:root:Epoch[7] Train-cross-entropy=0.651684
INFO:root:Epoch[7] Time cost=11.545
INFO:root:Epoch[7] Validation-accuracy=0.743490
INFO:root:Epoch[7] Validation-cross-entropy=0.731545
INFO:root:Epoch[8] Batch [20] Speed: 4374.35 samples/sec accuracy=0.772321 cross-entropy=0.669264
INFO:root:Epoch[8] Batch [40] Speed: 4278.54 samples/sec accuracy=0.764844 cross-entropy=0.670190
INFO:root:Epoch[8] Batch [60] Speed: 4186.20 samples/sec accuracy=0.766016 cross-entropy=0.678167
INFO:root:Epoch[8] Batch [80] Speed: 4277.52 samples/sec accuracy=0.780469 cross-entropy=0.663404
INFO:root:Epoch[8] Batch [100] Speed: 4387.01 samples/sec accuracy=0.774219 cross-entropy=0.664976
INFO:root:Epoch[8] Batch [120] Speed: 4273.64 samples/sec accuracy=0.760938 cross-entropy=0.679022
INFO:root:Epoch[8] Batch [140] Speed: 4359.29 samples/sec accuracy=0.769531 cross-entropy=0.646089
INFO:root:Epoch[8] Batch [160] Speed: 4274.55 samples/sec accuracy=0.777344 cross-entropy=0.645784
INFO:root:Epoch[8] Batch [180] Speed: 4306.36 samples/sec accuracy=0.776172 cross-entropy=0.646574
INFO:root:Epoch[8] Batch [200] Speed: 4294.51 samples/sec accuracy=0.785937 cross-entropy=0.641507
INFO:root:Epoch[8] Batch [220] Speed: 4336.37 samples/sec accuracy=0.758203 cross-entropy=0.695867
INFO:root:Epoch[8] Batch [240] Speed: 4258.24 samples/sec accuracy=0.776172 cross-entropy=0.629825
INFO:root:Epoch[8] Batch [260] Speed: 4256.65 samples/sec accuracy=0.772656 cross-entropy=0.648889
INFO:root:Epoch[8] Batch [280] Speed: 4317.12 samples/sec accuracy=0.767578 cross-entropy=0.643909
INFO:root:Epoch[8] Batch [300] Speed: 4277.07 samples/sec accuracy=0.772656 cross-entropy=0.649015
INFO:root:Epoch[8] Batch [320] Speed: 4376.21 samples/sec accuracy=0.785547 cross-entropy=0.618899
INFO:root:Epoch[8] Batch [340] Speed: 4395.99 samples/sec accuracy=0.796484 cross-entropy=0.614832
INFO:root:Epoch[8] Batch [360] Speed: 4215.98 samples/sec accuracy=0.783984 cross-entropy=0.634453
INFO:root:Epoch[8] Batch [380] Speed: 4142.01 samples/sec accuracy=0.781641 cross-entropy=0.622217
INFO:root:Epoch[8] Train-accuracy=0.770312
INFO:root:Epoch[8] Train-cross-entropy=0.670141
INFO:root:Epoch[8] Time cost=11.704
INFO:root:Epoch[8] Validation-accuracy=0.766119
INFO:root:Epoch[8] Validation-cross-entropy=0.707650
INFO:root:Epoch[9] Batch [20] Speed: 4405.11 samples/sec accuracy=0.781250 cross-entropy=0.614902
INFO:root:Epoch[9] Batch [40] Speed: 4218.01 samples/sec accuracy=0.767578 cross-entropy=0.645268
INFO:root:Epoch[9] Batch [60] Speed: 4349.68 samples/sec accuracy=0.775000 cross-entropy=0.646422
INFO:root:Epoch[9] Batch [80] Speed: 4408.70 samples/sec accuracy=0.785937 cross-entropy=0.611227
INFO:root:Epoch[9] Batch [100] Speed: 4263.30 samples/sec accuracy=0.783594 cross-entropy=0.646020
INFO:root:Epoch[9] Batch [120] Speed: 4353.00 samples/sec accuracy=0.792578 cross-entropy=0.613784
INFO:root:Epoch[9] Batch [140] Speed: 4272.93 samples/sec accuracy=0.782813 cross-entropy=0.610525
INFO:root:Epoch[9] Batch [160] Speed: 4305.33 samples/sec accuracy=0.774219 cross-entropy=0.649928
INFO:root:Epoch[9] Batch [180] Speed: 4335.64 samples/sec accuracy=0.790625 cross-entropy=0.617814
INFO:root:Epoch[9] Batch [200] Speed: 4312.99 samples/sec accuracy=0.787109 cross-entropy=0.626609
INFO:root:Epoch[9] Batch [220] Speed: 4384.61 samples/sec accuracy=0.793359 cross-entropy=0.614238
INFO:root:Epoch[9] Batch [240] Speed: 4403.64 samples/sec accuracy=0.780078 cross-entropy=0.604853
INFO:root:Epoch[9] Batch [260] Speed: 4322.51 samples/sec accuracy=0.796094 cross-entropy=0.602927
INFO:root:Epoch[9] Batch [280] Speed: 4306.12 samples/sec accuracy=0.794531 cross-entropy=0.588148
INFO:root:Epoch[9] Batch [300] Speed: 4236.20 samples/sec accuracy=0.782813 cross-entropy=0.620601
INFO:root:Epoch[9] Batch [320] Speed: 4297.77 samples/sec accuracy=0.800000 cross-entropy=0.575063
INFO:root:Epoch[9] Batch [340] Speed: 4324.94 samples/sec accuracy=0.792188 cross-entropy=0.600023
INFO:root:Epoch[9] Batch [360] Speed: 4399.28 samples/sec accuracy=0.785547 cross-entropy=0.617211
INFO:root:Epoch[9] Batch [380] Speed: 4364.99 samples/sec accuracy=0.783984 cross-entropy=0.614843
INFO:root:Epoch[9] Train-accuracy=0.797656
INFO:root:Epoch[9] Train-cross-entropy=0.607926
INFO:root:Epoch[9] Time cost=11.553
INFO:root:Epoch[9] Validation-accuracy=0.803486
INFO:root:Epoch[9] Validation-cross-entropy=0.572174
INFO:root:Epoch[10] Batch [20] Speed: 4354.68 samples/sec accuracy=0.786830 cross-entropy=0.616698
INFO:root:Epoch[10] Batch [40] Speed: 4401.75 samples/sec accuracy=0.801172 cross-entropy=0.593890
INFO:root:Epoch[10] Batch [60] Speed: 4374.27 samples/sec accuracy=0.788281 cross-entropy=0.618917
INFO:root:Epoch[10] Batch [80] Speed: 4342.94 samples/sec accuracy=0.794531 cross-entropy=0.601151
INFO:root:Epoch[10] Batch [100] Speed: 4292.59 samples/sec accuracy=0.794531 cross-entropy=0.600924
INFO:root:Epoch[10] Batch [120] Speed: 4332.89 samples/sec accuracy=0.783594 cross-entropy=0.602073
INFO:root:Epoch[10] Batch [140] Speed: 4409.72 samples/sec accuracy=0.789453 cross-entropy=0.608268
INFO:root:Epoch[10] Batch [160] Speed: 4325.24 samples/sec accuracy=0.786719 cross-entropy=0.594021
INFO:root:Epoch[10] Batch [180] Speed: 4245.77 samples/sec accuracy=0.785937 cross-entropy=0.620954
INFO:root:Epoch[10] Batch [200] Speed: 4363.03 samples/sec accuracy=0.791016 cross-entropy=0.609443
INFO:root:Epoch[10] Batch [220] Speed: 4393.61 samples/sec accuracy=0.785937 cross-entropy=0.595114
INFO:root:Epoch[10] Batch [240] Speed: 4384.41 samples/sec accuracy=0.801562 cross-entropy=0.572403
INFO:root:Epoch[10] Batch [260] Speed: 4294.75 samples/sec accuracy=0.793359 cross-entropy=0.585082
INFO:root:Epoch[10] Batch [280] Speed: 4293.46 samples/sec accuracy=0.785156 cross-entropy=0.599132
INFO:root:Epoch[10] Batch [300] Speed: 4295.03 samples/sec accuracy=0.802344 cross-entropy=0.575119
INFO:root:Epoch[10] Batch [320] Speed: 4333.10 samples/sec accuracy=0.788281 cross-entropy=0.606156
INFO:root:Epoch[10] Batch [340] Speed: 4346.91 samples/sec accuracy=0.809766 cross-entropy=0.550877
INFO:root:Epoch[10] Batch [360] Speed: 4162.26 samples/sec accuracy=0.798438 cross-entropy=0.583639
INFO:root:Epoch[10] Batch [380] Speed: 4130.30 samples/sec accuracy=0.798047 cross-entropy=0.586254
INFO:root:Epoch[10] Train-accuracy=0.785590
INFO:root:Epoch[10] Train-cross-entropy=0.595346
INFO:root:Epoch[10] Time cost=11.557
INFO:root:Epoch[10] Validation-accuracy=0.806691
INFO:root:Epoch[10] Validation-cross-entropy=0.583600
INFO:root:Epoch[11] Batch [20] Speed: 4155.62 samples/sec accuracy=0.804688 cross-entropy=0.570360
INFO:root:Epoch[11] Batch [40] Speed: 4300.59 samples/sec accuracy=0.800781 cross-entropy=0.578891
INFO:root:Epoch[11] Batch [60] Speed: 4144.18 samples/sec accuracy=0.793359 cross-entropy=0.601256
INFO:root:Epoch[11] Batch [80] Speed: 4254.65 samples/sec accuracy=0.799219 cross-entropy=0.589093
INFO:root:Epoch[11] Batch [100] Speed: 4286.94 samples/sec accuracy=0.805469 cross-entropy=0.582026
INFO:root:Epoch[11] Batch [120] Speed: 4262.60 samples/sec accuracy=0.796875 cross-entropy=0.593273
INFO:root:Epoch[11] Batch [140] Speed: 4329.72 samples/sec accuracy=0.799219 cross-entropy=0.584574
INFO:root:Epoch[11] Batch [160] Speed: 4315.29 samples/sec accuracy=0.793750 cross-entropy=0.582683
INFO:root:Epoch[11] Batch [180] Speed: 4325.87 samples/sec accuracy=0.795312 cross-entropy=0.586503
INFO:root:Epoch[11] Batch [200] Speed: 4246.24 samples/sec accuracy=0.799609 cross-entropy=0.593032
INFO:root:Epoch[11] Batch [220] Speed: 4167.06 samples/sec accuracy=0.811328 cross-entropy=0.565408
INFO:root:Epoch[11] Batch [240] Speed: 4299.62 samples/sec accuracy=0.804688 cross-entropy=0.551578
INFO:root:Epoch[11] Batch [260] Speed: 4320.80 samples/sec accuracy=0.808203 cross-entropy=0.570192
INFO:root:Epoch[11] Batch [280] Speed: 4292.68 samples/sec accuracy=0.792969 cross-entropy=0.598713
INFO:root:Epoch[11] Batch [300] Speed: 4241.77 samples/sec accuracy=0.796094 cross-entropy=0.595665
INFO:root:Epoch[11] Batch [320] Speed: 4235.77 samples/sec accuracy=0.813672 cross-entropy=0.545584
INFO:root:Epoch[11] Batch [340] Speed: 4176.23 samples/sec accuracy=0.800781 cross-entropy=0.584906
INFO:root:Epoch[11] Batch [360] Speed: 4280.39 samples/sec accuracy=0.809375 cross-entropy=0.538782
INFO:root:Epoch[11] Batch [380] Speed: 4215.09 samples/sec accuracy=0.822656 cross-entropy=0.523130
INFO:root:Epoch[11] Train-accuracy=0.785156
INFO:root:Epoch[11] Train-cross-entropy=0.615012
INFO:root:Epoch[11] Time cost=11.758
INFO:root:Epoch[11] Validation-accuracy=0.804287
INFO:root:Epoch[11] Validation-cross-entropy=0.580835
INFO:root:Epoch[12] Batch [20] Speed: 4370.62 samples/sec accuracy=0.806176 cross-entropy=0.552160
INFO:root:Epoch[12] Batch [40] Speed: 4211.57 samples/sec accuracy=0.802344 cross-entropy=0.574776
INFO:root:Epoch[12] Batch [60] Speed: 4216.46 samples/sec accuracy=0.801172 cross-entropy=0.568467
INFO:root:Epoch[12] Batch [80] Speed: 4231.81 samples/sec accuracy=0.816406 cross-entropy=0.568060
INFO:root:Epoch[12] Batch [100] Speed: 4235.12 samples/sec accuracy=0.804688 cross-entropy=0.603951
INFO:root:Epoch[12] Batch [120] Speed: 4246.33 samples/sec accuracy=0.803906 cross-entropy=0.555888
INFO:root:Epoch[12] Batch [140] Speed: 4180.18 samples/sec accuracy=0.803125 cross-entropy=0.566752
INFO:root:Epoch[12] Batch [160] Speed: 4274.73 samples/sec accuracy=0.808594 cross-entropy=0.547277
INFO:root:Epoch[12] Batch [180] Speed: 4267.99 samples/sec accuracy=0.804688 cross-entropy=0.541453
INFO:root:Epoch[12] Batch [200] Speed: 4226.93 samples/sec accuracy=0.801953 cross-entropy=0.576505
INFO:root:Epoch[12] Batch [220] Speed: 4142.00 samples/sec accuracy=0.809766 cross-entropy=0.550067
INFO:root:Epoch[12] Batch [240] Speed: 4175.64 samples/sec accuracy=0.803125 cross-entropy=0.553702
INFO:root:Epoch[12] Batch [260] Speed: 4272.92 samples/sec accuracy=0.808984 cross-entropy=0.556443
INFO:root:Epoch[12] Batch [280] Speed: 4210.86 samples/sec accuracy=0.806641 cross-entropy=0.543365
INFO:root:Epoch[12] Batch [300] Speed: 4163.16 samples/sec accuracy=0.805469 cross-entropy=0.567185
INFO:root:Epoch[12] Batch [320] Speed: 4197.07 samples/sec accuracy=0.821094 cross-entropy=0.546230
INFO:root:Epoch[12] Batch [340] Speed: 4235.55 samples/sec accuracy=0.814063 cross-entropy=0.540283
INFO:root:Epoch[12] Batch [360] Speed: 4216.65 samples/sec accuracy=0.809766 cross-entropy=0.551188
INFO:root:Epoch[12] Batch [380] Speed: 4306.18 samples/sec accuracy=0.804297 cross-entropy=0.563667
INFO:root:Epoch[12] Train-accuracy=0.822656
INFO:root:Epoch[12] Train-cross-entropy=0.508308
INFO:root:Epoch[12] Time cost=11.833
INFO:root:Epoch[12] Validation-accuracy=0.821114
INFO:root:Epoch[12] Validation-cross-entropy=0.522113
INFO:root:Epoch[13] Batch [20] Speed: 4271.12 samples/sec accuracy=0.816220 cross-entropy=0.529724
INFO:root:Epoch[13] Batch [40] Speed: 4309.54 samples/sec accuracy=0.815625 cross-entropy=0.534115
INFO:root:Epoch[13] Batch [60] Speed: 4290.31 samples/sec accuracy=0.808203 cross-entropy=0.553422
INFO:root:Epoch[13] Batch [80] Speed: 4133.94 samples/sec accuracy=0.819531 cross-entropy=0.544125
INFO:root:Epoch[13] Batch [100] Speed: 4294.45 samples/sec accuracy=0.816797 cross-entropy=0.548095
INFO:root:Epoch[13] Batch [120] Speed: 4304.43 samples/sec accuracy=0.810547 cross-entropy=0.540950
INFO:root:Epoch[13] Batch [140] Speed: 4256.05 samples/sec accuracy=0.804688 cross-entropy=0.560325
INFO:root:Epoch[13] Batch [160] Speed: 4227.60 samples/sec accuracy=0.805078 cross-entropy=0.572197
INFO:root:Epoch[13] Batch [180] Speed: 4159.98 samples/sec accuracy=0.815625 cross-entropy=0.524096
INFO:root:Epoch[13] Batch [200] Speed: 4201.43 samples/sec accuracy=0.809766 cross-entropy=0.572627
INFO:root:Epoch[13] Batch [220] Speed: 4229.04 samples/sec accuracy=0.803125 cross-entropy=0.569623
INFO:root:Epoch[13] Batch [240] Speed: 4195.70 samples/sec accuracy=0.813672 cross-entropy=0.528090
INFO:root:Epoch[13] Batch [260] Speed: 4255.46 samples/sec accuracy=0.812500 cross-entropy=0.547092
INFO:root:Epoch[13] Batch [280] Speed: 4234.64 samples/sec accuracy=0.816016 cross-entropy=0.538972
INFO:root:Epoch[13] Batch [300] Speed: 4215.27 samples/sec accuracy=0.812891 cross-entropy=0.565797
INFO:root:Epoch[13] Batch [320] Speed: 4306.48 samples/sec accuracy=0.810937 cross-entropy=0.546423
INFO:root:Epoch[13] Batch [340] Speed: 4186.82 samples/sec accuracy=0.817578 cross-entropy=0.527626
INFO:root:Epoch[13] Batch [360] Speed: 4275.42 samples/sec accuracy=0.814063 cross-entropy=0.537284
INFO:root:Epoch[13] Batch [380] Speed: 4281.77 samples/sec accuracy=0.813281 cross-entropy=0.541993
INFO:root:Epoch[13] Train-accuracy=0.826389
INFO:root:Epoch[13] Train-cross-entropy=0.536465
INFO:root:Epoch[13] Time cost=11.764
INFO:root:Epoch[13] Validation-accuracy=0.815605
INFO:root:Epoch[13] Validation-cross-entropy=0.523868
INFO:root:Epoch[14] Batch [20] Speed: 4234.65 samples/sec accuracy=0.818080 cross-entropy=0.527991
INFO:root:Epoch[14] Batch [40] Speed: 4302.59 samples/sec accuracy=0.825781 cross-entropy=0.521563
INFO:root:Epoch[14] Batch [60] Speed: 4237.83 samples/sec accuracy=0.830469 cross-entropy=0.518909
INFO:root:Epoch[14] Batch [80] Speed: 4391.73 samples/sec accuracy=0.835156 cross-entropy=0.495537
INFO:root:Epoch[14] Batch [100] Speed: 4254.11 samples/sec accuracy=0.817578 cross-entropy=0.537145
INFO:root:Epoch[14] Batch [120] Speed: 4317.80 samples/sec accuracy=0.811719 cross-entropy=0.521060
INFO:root:Epoch[14] Batch [140] Speed: 4256.09 samples/sec accuracy=0.816016 cross-entropy=0.522308
INFO:root:Epoch[14] Batch [160] Speed: 4306.52 samples/sec accuracy=0.809766 cross-entropy=0.548013
INFO:root:Epoch[14] Batch [180] Speed: 4344.40 samples/sec accuracy=0.814844 cross-entropy=0.526475
INFO:root:Epoch[14] Batch [200] Speed: 4310.87 samples/sec accuracy=0.816406 cross-entropy=0.532631
INFO:root:Epoch[14] Batch [220] Speed: 4282.18 samples/sec accuracy=0.814844 cross-entropy=0.523395
INFO:root:Epoch[14] Batch [240] Speed: 4233.94 samples/sec accuracy=0.818359 cross-entropy=0.518927
INFO:root:Epoch[14] Batch [260] Speed: 4197.56 samples/sec accuracy=0.813672 cross-entropy=0.541174
INFO:root:Epoch[14] Batch [280] Speed: 4096.42 samples/sec accuracy=0.813281 cross-entropy=0.536533
INFO:root:Epoch[14] Batch [300] Speed: 4244.55 samples/sec accuracy=0.828906 cross-entropy=0.499922
INFO:root:Epoch[14] Batch [320] Speed: 4163.86 samples/sec accuracy=0.819531 cross-entropy=0.511346
INFO:root:Epoch[14] Batch [340] Speed: 4261.54 samples/sec accuracy=0.833203 cross-entropy=0.485668
INFO:root:Epoch[14] Batch [360] Speed: 4193.18 samples/sec accuracy=0.825781 cross-entropy=0.502734
INFO:root:Epoch[14] Batch [380] Speed: 4207.11 samples/sec accuracy=0.830078 cross-entropy=0.488201
INFO:root:Epoch[14] Train-accuracy=0.828906
INFO:root:Epoch[14] Train-cross-entropy=0.514260
INFO:root:Epoch[14] Time cost=11.754
INFO:root:Epoch[14] Validation-accuracy=0.837340
INFO:root:Epoch[14] Validation-cross-entropy=0.487636
INFO:root:Epoch[15] Batch [20] Speed: 4209.29 samples/sec accuracy=0.824777 cross-entropy=0.498991
INFO:root:Epoch[15] Batch [40] Speed: 4257.27 samples/sec accuracy=0.815625 cross-entropy=0.529787
INFO:root:Epoch[15] Batch [60] Speed: 4243.41 samples/sec accuracy=0.818359 cross-entropy=0.527474
INFO:root:Epoch[15] Batch [80] Speed: 4296.18 samples/sec accuracy=0.829688 cross-entropy=0.502663
INFO:root:Epoch[15] Batch [100] Speed: 4188.33 samples/sec accuracy=0.814063 cross-entropy=0.537684
INFO:root:Epoch[15] Batch [120] Speed: 4322.26 samples/sec accuracy=0.814063 cross-entropy=0.529208
INFO:root:Epoch[15] Batch [140] Speed: 4271.10 samples/sec accuracy=0.819141 cross-entropy=0.501382
INFO:root:Epoch[15] Batch [160] Speed: 4195.38 samples/sec accuracy=0.813672 cross-entropy=0.525802
INFO:root:Epoch[15] Batch [180] Speed: 4187.43 samples/sec accuracy=0.816797 cross-entropy=0.526746
INFO:root:Epoch[15] Batch [200] Speed: 4272.61 samples/sec accuracy=0.817969 cross-entropy=0.522355
INFO:root:Epoch[15] Batch [220] Speed: 4273.70 samples/sec accuracy=0.818750 cross-entropy=0.507837
INFO:root:Epoch[15] Batch [240] Speed: 4215.86 samples/sec accuracy=0.817187 cross-entropy=0.503346
INFO:root:Epoch[15] Batch [260] Speed: 4214.53 samples/sec accuracy=0.823828 cross-entropy=0.499235
INFO:root:Epoch[15] Batch [280] Speed: 4187.34 samples/sec accuracy=0.823047 cross-entropy=0.519479
INFO:root:Epoch[15] Batch [300] Speed: 4180.27 samples/sec accuracy=0.825000 cross-entropy=0.512530
INFO:root:Epoch[15] Batch [320] Speed: 4246.18 samples/sec accuracy=0.821484 cross-entropy=0.507399
INFO:root:Epoch[15] Batch [340] Speed: 4315.02 samples/sec accuracy=0.823828 cross-entropy=0.504396
INFO:root:Epoch[15] Batch [360] Speed: 4223.47 samples/sec accuracy=0.828516 cross-entropy=0.494661
INFO:root:Epoch[15] Batch [380] Speed: 4236.66 samples/sec accuracy=0.818359 cross-entropy=0.509411
INFO:root:Epoch[15] Train-accuracy=0.822917
INFO:root:Epoch[15] Train-cross-entropy=0.507375
INFO:root:Epoch[15] Time cost=11.766
INFO:root:Epoch[15] Validation-accuracy=0.829828
INFO:root:Epoch[15] Validation-cross-entropy=0.501222
INFO:root:Epoch[16] Batch [20] Speed: 4249.29 samples/sec accuracy=0.821057 cross-entropy=0.525262
INFO:root:Epoch[16] Batch [40] Speed: 4155.48 samples/sec accuracy=0.823828 cross-entropy=0.502692
INFO:root:Epoch[16] Batch [60] Speed: 4125.75 samples/sec accuracy=0.817187 cross-entropy=0.511033
INFO:root:Epoch[16] Batch [80] Speed: 4155.51 samples/sec accuracy=0.824609 cross-entropy=0.508859
INFO:root:Epoch[16] Batch [100] Speed: 4233.80 samples/sec accuracy=0.828516 cross-entropy=0.494233
INFO:root:Epoch[16] Batch [120] Speed: 4133.17 samples/sec accuracy=0.828516 cross-entropy=0.495411
INFO:root:Epoch[16] Batch [140] Speed: 4123.89 samples/sec accuracy=0.830078 cross-entropy=0.489456
INFO:root:Epoch[16] Batch [160] Speed: 4106.66 samples/sec accuracy=0.825391 cross-entropy=0.508328
INFO:root:Epoch[16] Batch [180] Speed: 4178.45 samples/sec accuracy=0.818359 cross-entropy=0.523870
INFO:root:Epoch[16] Batch [200] Speed: 4212.29 samples/sec accuracy=0.825391 cross-entropy=0.514953
INFO:root:Epoch[16] Batch [220] Speed: 4113.94 samples/sec accuracy=0.823438 cross-entropy=0.493564
INFO:root:Epoch[16] Batch [240] Speed: 4164.46 samples/sec accuracy=0.838672 cross-entropy=0.472492
INFO:root:Epoch[16] Batch [260] Speed: 4190.22 samples/sec accuracy=0.828516 cross-entropy=0.484583
INFO:root:Epoch[16] Batch [280] Speed: 4112.17 samples/sec accuracy=0.827734 cross-entropy=0.500976
INFO:root:Epoch[16] Batch [300] Speed: 4177.36 samples/sec accuracy=0.828125 cross-entropy=0.508130
INFO:root:Epoch[16] Batch [320] Speed: 4058.02 samples/sec accuracy=0.834766 cross-entropy=0.480375
INFO:root:Epoch[16] Batch [340] Speed: 4002.12 samples/sec accuracy=0.838672 cross-entropy=0.456721
INFO:root:Epoch[16] Batch [360] Speed: 4053.85 samples/sec accuracy=0.825000 cross-entropy=0.509024
INFO:root:Epoch[16] Batch [380] Speed: 4021.96 samples/sec accuracy=0.825391 cross-entropy=0.502854
INFO:root:Epoch[16] Train-accuracy=0.843750
INFO:root:Epoch[16] Train-cross-entropy=0.472713
INFO:root:Epoch[16] Time cost=12.138
INFO:root:Epoch[16] Validation-accuracy=0.835344
INFO:root:Epoch[16] Validation-cross-entropy=0.475281
INFO:root:Epoch[17] Batch [20] Speed: 4169.96 samples/sec accuracy=0.838914 cross-entropy=0.474806
INFO:root:Epoch[17] Batch [40] Speed: 4201.26 samples/sec accuracy=0.840625 cross-entropy=0.480282
INFO:root:Epoch[17] Batch [60] Speed: 4099.53 samples/sec accuracy=0.833984 cross-entropy=0.495609
INFO:root:Epoch[17] Batch [80] Speed: 4194.51 samples/sec accuracy=0.823828 cross-entropy=0.506988
INFO:root:Epoch[17] Batch [100] Speed: 4147.90 samples/sec accuracy=0.825391 cross-entropy=0.508518
INFO:root:Epoch[17] Batch [120] Speed: 4166.84 samples/sec accuracy=0.830078 cross-entropy=0.487704
INFO:root:Epoch[17] Batch [140] Speed: 4072.11 samples/sec accuracy=0.829688 cross-entropy=0.488799
INFO:root:Epoch[17] Batch [160] Speed: 4167.82 samples/sec accuracy=0.825391 cross-entropy=0.487349
INFO:root:Epoch[17] Batch [180] Speed: 4078.63 samples/sec accuracy=0.822656 cross-entropy=0.499951
INFO:root:Epoch[17] Batch [200] Speed: 4072.94 samples/sec accuracy=0.816406 cross-entropy=0.528455
INFO:root:Epoch[17] Batch [220] Speed: 4028.27 samples/sec accuracy=0.832422 cross-entropy=0.484558
INFO:root:Epoch[17] Batch [240] Speed: 4098.97 samples/sec accuracy=0.827344 cross-entropy=0.485386
INFO:root:Epoch[17] Batch [260] Speed: 3960.32 samples/sec accuracy=0.828906 cross-entropy=0.498550
INFO:root:Epoch[17] Batch [280] Speed: 4160.02 samples/sec accuracy=0.833203 cross-entropy=0.467794
INFO:root:Epoch[17] Batch [300] Speed: 4222.87 samples/sec accuracy=0.832812 cross-entropy=0.488286
INFO:root:Epoch[17] Batch [320] Speed: 4085.61 samples/sec accuracy=0.832812 cross-entropy=0.484402
INFO:root:Epoch[17] Batch [340] Speed: 4212.01 samples/sec accuracy=0.835547 cross-entropy=0.470226
INFO:root:Epoch[17] Batch [360] Speed: 4136.24 samples/sec accuracy=0.844141 cross-entropy=0.458950
INFO:root:Epoch[17] Batch [380] Speed: 4152.62 samples/sec accuracy=0.830078 cross-entropy=0.497353
INFO:root:Epoch[17] Train-accuracy=0.835156
INFO:root:Epoch[17] Train-cross-entropy=0.476684
INFO:root:Epoch[17] Time cost=12.122
INFO:root:Epoch[17] Validation-accuracy=0.842548
INFO:root:Epoch[17] Validation-cross-entropy=0.468031
INFO:root:Epoch[18] Batch [20] Speed: 4103.00 samples/sec accuracy=0.845610 cross-entropy=0.459438
INFO:root:Epoch[18] Batch [40] Speed: 4216.94 samples/sec accuracy=0.834375 cross-entropy=0.492007
INFO:root:Epoch[18] Batch [60] Speed: 4186.67 samples/sec accuracy=0.829688 cross-entropy=0.487585
INFO:root:Epoch[18] Batch [80] Speed: 4127.51 samples/sec accuracy=0.833594 cross-entropy=0.495969
INFO:root:Epoch[18] Batch [100] Speed: 4097.64 samples/sec accuracy=0.830859 cross-entropy=0.483220
INFO:root:Epoch[18] Batch [120] Speed: 3999.81 samples/sec accuracy=0.834766 cross-entropy=0.484754
INFO:root:Epoch[18] Batch [140] Speed: 4098.39 samples/sec accuracy=0.830859 cross-entropy=0.478153
INFO:root:Epoch[18] Batch [160] Speed: 4173.72 samples/sec accuracy=0.837891 cross-entropy=0.460297
INFO:root:Epoch[18] Batch [180] Speed: 4084.88 samples/sec accuracy=0.831250 cross-entropy=0.488043
INFO:root:Epoch[18] Batch [200] Speed: 4024.50 samples/sec accuracy=0.829297 cross-entropy=0.499610
INFO:root:Epoch[18] Batch [220] Speed: 3958.31 samples/sec accuracy=0.838281 cross-entropy=0.465445
INFO:root:Epoch[18] Batch [240] Speed: 4089.41 samples/sec accuracy=0.835547 cross-entropy=0.490029
INFO:root:Epoch[18] Batch [260] Speed: 4210.83 samples/sec accuracy=0.843750 cross-entropy=0.442880
INFO:root:Epoch[18] Batch [280] Speed: 4159.65 samples/sec accuracy=0.835547 cross-entropy=0.480638
INFO:root:Epoch[18] Batch [300] Speed: 4207.92 samples/sec accuracy=0.836328 cross-entropy=0.476824
INFO:root:Epoch[18] Batch [320] Speed: 4253.76 samples/sec accuracy=0.835156 cross-entropy=0.475977
INFO:root:Epoch[18] Batch [340] Speed: 4167.86 samples/sec accuracy=0.825391 cross-entropy=0.505823
INFO:root:Epoch[18] Batch [360] Speed: 4167.14 samples/sec accuracy=0.853906 cross-entropy=0.440378
INFO:root:Epoch[18] Batch [380] Speed: 4273.61 samples/sec accuracy=0.834375 cross-entropy=0.498614
INFO:root:Epoch[18] Train-accuracy=0.825521
INFO:root:Epoch[18] Train-cross-entropy=0.490608
INFO:root:Epoch[18] Time cost=12.056
INFO:root:Epoch[18] Validation-accuracy=0.821114
INFO:root:Epoch[18] Validation-cross-entropy=0.521607
INFO:root:Epoch[19] Batch [20] Speed: 4173.02 samples/sec accuracy=0.835193 cross-entropy=0.452938
INFO:root:Epoch[19] Batch [40] Speed: 4176.76 samples/sec accuracy=0.836328 cross-entropy=0.465481
INFO:root:Epoch[19] Batch [60] Speed: 4213.75 samples/sec accuracy=0.823047 cross-entropy=0.503971
INFO:root:Epoch[19] Batch [80] Speed: 4058.60 samples/sec accuracy=0.841797 cross-entropy=0.468222
INFO:root:Epoch[19] Batch [100] Speed: 4105.53 samples/sec accuracy=0.833984 cross-entropy=0.477184
INFO:root:Epoch[19] Batch [120] Speed: 4254.97 samples/sec accuracy=0.843750 cross-entropy=0.463808
INFO:root:Epoch[19] Batch [140] Speed: 4155.08 samples/sec accuracy=0.819531 cross-entropy=0.512672
INFO:root:Epoch[19] Batch [160] Speed: 4269.23 samples/sec accuracy=0.843359 cross-entropy=0.459543
INFO:root:Epoch[19] Batch [180] Speed: 4027.04 samples/sec accuracy=0.828125 cross-entropy=0.493695
INFO:root:Epoch[19] Batch [200] Speed: 4177.71 samples/sec accuracy=0.832812 cross-entropy=0.497876
INFO:root:Epoch[19] Batch [220] Speed: 4090.10 samples/sec accuracy=0.840625 cross-entropy=0.464214
INFO:root:Epoch[19] Batch [240] Speed: 4179.47 samples/sec accuracy=0.839063 cross-entropy=0.460876
INFO:root:Epoch[19] Batch [260] Speed: 4069.79 samples/sec accuracy=0.837891 cross-entropy=0.453055
INFO:root:Epoch[19] Batch [280] Speed: 4038.80 samples/sec accuracy=0.832031 cross-entropy=0.459326
INFO:root:Epoch[19] Batch [300] Speed: 4088.73 samples/sec accuracy=0.840625 cross-entropy=0.440138
INFO:root:Epoch[19] Batch [320] Speed: 4083.13 samples/sec accuracy=0.838672 cross-entropy=0.475694
INFO:root:Epoch[19] Batch [340] Speed: 4220.88 samples/sec accuracy=0.835547 cross-entropy=0.467536
INFO:root:Epoch[19] Batch [360] Speed: 4159.88 samples/sec accuracy=0.848437 cross-entropy=0.445257
INFO:root:Epoch[19] Batch [380] Speed: 4107.01 samples/sec accuracy=0.852734 cross-entropy=0.445418
INFO:root:Epoch[19] Train-accuracy=0.847656
INFO:root:Epoch[19] Train-cross-entropy=0.452986
INFO:root:Epoch[19] Time cost=12.092
INFO:root:Epoch[19] Validation-accuracy=0.836538
INFO:root:Epoch[19] Validation-cross-entropy=0.487689
INFO:root:Epoch[20] Batch [20] Speed: 4174.71 samples/sec accuracy=0.846354 cross-entropy=0.458082
INFO:root:Epoch[20] Batch [40] Speed: 4192.25 samples/sec accuracy=0.837891 cross-entropy=0.471646
INFO:root:Epoch[20] Batch [60] Speed: 4087.80 samples/sec accuracy=0.835938 cross-entropy=0.474125
INFO:root:Epoch[20] Batch [80] Speed: 4007.78 samples/sec accuracy=0.850000 cross-entropy=0.449394
INFO:root:Epoch[20] Batch [100] Speed: 4047.59 samples/sec accuracy=0.842187 cross-entropy=0.473653
INFO:root:Epoch[20] Batch [120] Speed: 4145.89 samples/sec accuracy=0.826172 cross-entropy=0.471175
INFO:root:Epoch[20] Batch [140] Speed: 4123.29 samples/sec accuracy=0.856250 cross-entropy=0.451280
INFO:root:Epoch[20] Batch [160] Speed: 4184.31 samples/sec accuracy=0.838281 cross-entropy=0.445546
INFO:root:Epoch[20] Batch [180] Speed: 4071.96 samples/sec accuracy=0.838281 cross-entropy=0.456298
INFO:root:Epoch[20] Batch [200] Speed: 4123.38 samples/sec accuracy=0.835547 cross-entropy=0.468735
INFO:root:Epoch[20] Batch [220] Speed: 4230.08 samples/sec accuracy=0.843750 cross-entropy=0.447974
INFO:root:Epoch[20] Batch [240] Speed: 4057.30 samples/sec accuracy=0.831250 cross-entropy=0.470798
INFO:root:Epoch[20] Batch [260] Speed: 4169.71 samples/sec accuracy=0.841406 cross-entropy=0.458991
INFO:root:Epoch[20] Batch [280] Speed: 4208.39 samples/sec accuracy=0.841016 cross-entropy=0.450081
INFO:root:Epoch[20] Batch [300] Speed: 4197.11 samples/sec accuracy=0.842578 cross-entropy=0.465386
INFO:root:Epoch[20] Batch [320] Speed: 4160.64 samples/sec accuracy=0.850391 cross-entropy=0.425484
INFO:root:Epoch[20] Batch [340] Speed: 4100.90 samples/sec accuracy=0.847266 cross-entropy=0.450404
INFO:root:Epoch[20] Batch [360] Speed: 4148.25 samples/sec accuracy=0.837891 cross-entropy=0.470687
INFO:root:Epoch[20] Batch [380] Speed: 4181.24 samples/sec accuracy=0.847656 cross-entropy=0.446722
INFO:root:Epoch[20] Train-accuracy=0.840625
INFO:root:Epoch[20] Train-cross-entropy=0.453533
INFO:root:Epoch[20] Time cost=12.088
INFO:root:Epoch[20] Validation-accuracy=0.830228
INFO:root:Epoch[20] Validation-cross-entropy=0.499056
INFO:root:Epoch[21] Batch [20] Speed: 4210.46 samples/sec accuracy=0.842634 cross-entropy=0.448673
INFO:root:Epoch[21] Batch [40] Speed: 4161.71 samples/sec accuracy=0.835547 cross-entropy=0.455007
INFO:root:Epoch[21] Batch [60] Speed: 4202.29 samples/sec accuracy=0.842187 cross-entropy=0.464614
INFO:root:Epoch[21] Batch [80] Speed: 4171.03 samples/sec accuracy=0.843359 cross-entropy=0.459417
INFO:root:Epoch[21] Batch [100] Speed: 4059.95 samples/sec accuracy=0.844531 cross-entropy=0.453745
INFO:root:Epoch[21] Batch [120] Speed: 4073.90 samples/sec accuracy=0.839453 cross-entropy=0.473754
INFO:root:Epoch[21] Batch [140] Speed: 4175.42 samples/sec accuracy=0.837891 cross-entropy=0.450297
INFO:root:Epoch[21] Batch [160] Speed: 4243.34 samples/sec accuracy=0.841797 cross-entropy=0.454799
INFO:root:Epoch[21] Batch [180] Speed: 4144.45 samples/sec accuracy=0.843750 cross-entropy=0.450691
INFO:root:Epoch[21] Batch [200] Speed: 4178.17 samples/sec accuracy=0.835156 cross-entropy=0.477784
INFO:root:Epoch[21] Batch [220] Speed: 4168.66 samples/sec accuracy=0.853906 cross-entropy=0.428080
INFO:root:Epoch[21] Batch [240] Speed: 4118.99 samples/sec accuracy=0.846875 cross-entropy=0.436121
INFO:root:Epoch[21] Batch [260] Speed: 4034.76 samples/sec accuracy=0.850781 cross-entropy=0.435824
INFO:root:Epoch[21] Batch [280] Speed: 4108.87 samples/sec accuracy=0.844141 cross-entropy=0.436348
INFO:root:Epoch[21] Batch [300] Speed: 4126.47 samples/sec accuracy=0.839063 cross-entropy=0.461349
INFO:root:Epoch[21] Batch [320] Speed: 4222.84 samples/sec accuracy=0.844141 cross-entropy=0.458220
INFO:root:Epoch[21] Batch [340] Speed: 4206.23 samples/sec accuracy=0.849609 cross-entropy=0.431717
INFO:root:Epoch[21] Batch [360] Speed: 4161.44 samples/sec accuracy=0.832812 cross-entropy=0.462002
INFO:root:Epoch[21] Batch [380] Speed: 4119.14 samples/sec accuracy=0.844141 cross-entropy=0.454961
INFO:root:Epoch[21] Train-accuracy=0.855035
INFO:root:Epoch[21] Train-cross-entropy=0.425552
INFO:root:Epoch[21] Time cost=12.019
INFO:root:Epoch[21] Validation-accuracy=0.855369
INFO:root:Epoch[21] Validation-cross-entropy=0.417909
INFO:root:Epoch[22] Batch [20] Speed: 4101.68 samples/sec accuracy=0.834077 cross-entropy=0.459338
INFO:root:Epoch[22] Batch [40] Speed: 4158.51 samples/sec accuracy=0.846484 cross-entropy=0.447851
INFO:root:Epoch[22] Batch [60] Speed: 4110.62 samples/sec accuracy=0.842187 cross-entropy=0.480154
INFO:root:Epoch[22] Batch [80] Speed: 4148.16 samples/sec accuracy=0.841797 cross-entropy=0.469478
INFO:root:Epoch[22] Batch [100] Speed: 4074.82 samples/sec accuracy=0.842969 cross-entropy=0.462996
INFO:root:Epoch[22] Batch [120] Speed: 4022.87 samples/sec accuracy=0.844531 cross-entropy=0.430411
INFO:root:Epoch[22] Batch [140] Speed: 4019.05 samples/sec accuracy=0.841016 cross-entropy=0.463437
INFO:root:Epoch[22] Batch [160] Speed: 4173.72 samples/sec accuracy=0.853516 cross-entropy=0.420611
INFO:root:Epoch[22] Batch [180] Speed: 4119.90 samples/sec accuracy=0.847656 cross-entropy=0.427340
INFO:root:Epoch[22] Batch [200] Speed: 4164.14 samples/sec accuracy=0.837891 cross-entropy=0.467674
INFO:root:Epoch[22] Batch [220] Speed: 4116.15 samples/sec accuracy=0.855859 cross-entropy=0.424440
INFO:root:Epoch[22] Batch [240] Speed: 4133.55 samples/sec accuracy=0.842969 cross-entropy=0.425183
INFO:root:Epoch[22] Batch [260] Speed: 4141.85 samples/sec accuracy=0.846875 cross-entropy=0.450216
INFO:root:Epoch[22] Batch [280] Speed: 4185.25 samples/sec accuracy=0.841797 cross-entropy=0.446918
INFO:root:Epoch[22] Batch [300] Speed: 4182.79 samples/sec accuracy=0.851953 cross-entropy=0.452544
INFO:root:Epoch[22] Batch [320] Speed: 4170.73 samples/sec accuracy=0.851172 cross-entropy=0.442488
INFO:root:Epoch[22] Batch [340] Speed: 4085.12 samples/sec accuracy=0.858594 cross-entropy=0.413931
INFO:root:Epoch[22] Batch [360] Speed: 4182.84 samples/sec accuracy=0.842969 cross-entropy=0.436918
INFO:root:Epoch[22] Batch [380] Speed: 4164.51 samples/sec accuracy=0.843750 cross-entropy=0.434541
INFO:root:Epoch[22] Train-accuracy=0.847656
INFO:root:Epoch[22] Train-cross-entropy=0.464525
INFO:root:Epoch[22] Time cost=12.126
INFO:root:Epoch[22] Validation-accuracy=0.836238
INFO:root:Epoch[22] Validation-cross-entropy=0.477666
INFO:root:Epoch[23] Batch [20] Speed: 4146.70 samples/sec accuracy=0.847842 cross-entropy=0.433898
INFO:root:Epoch[23] Batch [40] Speed: 4204.66 samples/sec accuracy=0.850000 cross-entropy=0.442810
INFO:root:Epoch[23] Batch [60] Speed: 4148.55 samples/sec accuracy=0.847266 cross-entropy=0.454879
INFO:root:Epoch[23] Batch [80] Speed: 4070.56 samples/sec accuracy=0.848437 cross-entropy=0.426139
INFO:root:Epoch[23] Batch [100] Speed: 4114.48 samples/sec accuracy=0.843359 cross-entropy=0.452541
INFO:root:Epoch[23] Batch [120] Speed: 4238.21 samples/sec accuracy=0.846484 cross-entropy=0.427684
INFO:root:Epoch[23] Batch [140] Speed: 4045.13 samples/sec accuracy=0.848437 cross-entropy=0.444012
INFO:root:Epoch[23] Batch [160] Speed: 4068.05 samples/sec accuracy=0.841016 cross-entropy=0.453845
INFO:root:Epoch[23] Batch [180] Speed: 4250.90 samples/sec accuracy=0.845703 cross-entropy=0.436066
INFO:root:Epoch[23] Batch [200] Speed: 4167.62 samples/sec accuracy=0.850781 cross-entropy=0.444520
INFO:root:Epoch[23] Batch [220] Speed: 4189.02 samples/sec accuracy=0.847656 cross-entropy=0.445081
INFO:root:Epoch[23] Batch [240] Speed: 4062.68 samples/sec accuracy=0.854297 cross-entropy=0.419434
INFO:root:Epoch[23] Batch [260] Speed: 4129.91 samples/sec accuracy=0.858984 cross-entropy=0.411492
INFO:root:Epoch[23] Batch [280] Speed: 4103.47 samples/sec accuracy=0.841406 cross-entropy=0.449494
INFO:root:Epoch[23] Batch [300] Speed: 4071.50 samples/sec accuracy=0.846094 cross-entropy=0.445431
INFO:root:Epoch[23] Batch [320] Speed: 4046.49 samples/sec accuracy=0.844141 cross-entropy=0.445651
INFO:root:Epoch[23] Batch [340] Speed: 3901.49 samples/sec accuracy=0.866406 cross-entropy=0.398392
INFO:root:Epoch[23] Batch [360] Speed: 4074.07 samples/sec accuracy=0.860156 cross-entropy=0.400364
INFO:root:Epoch[23] Batch [380] Speed: 4037.63 samples/sec accuracy=0.855078 cross-entropy=0.421512
INFO:root:Epoch[23] Train-accuracy=0.834201
INFO:root:Epoch[23] Train-cross-entropy=0.488873
INFO:root:Epoch[23] Time cost=12.146
INFO:root:Epoch[23] Validation-accuracy=0.847155
INFO:root:Epoch[23] Validation-cross-entropy=0.461851
INFO:root:Epoch[24] Batch [20] Speed: 4142.02 samples/sec accuracy=0.850818 cross-entropy=0.428110
INFO:root:Epoch[24] Batch [40] Speed: 4018.95 samples/sec accuracy=0.855078 cross-entropy=0.430938
INFO:root:Epoch[24] Batch [60] Speed: 4286.22 samples/sec accuracy=0.847266 cross-entropy=0.428738
INFO:root:Epoch[24] Batch [80] Speed: 4094.87 samples/sec accuracy=0.847656 cross-entropy=0.435249
INFO:root:Epoch[24] Batch [100] Speed: 4147.50 samples/sec accuracy=0.849219 cross-entropy=0.442954
INFO:root:Epoch[24] Batch [120] Speed: 4068.26 samples/sec accuracy=0.846484 cross-entropy=0.442910
INFO:root:Epoch[24] Batch [140] Speed: 4014.84 samples/sec accuracy=0.850391 cross-entropy=0.431101
INFO:root:Epoch[24] Batch [160] Speed: 4103.03 samples/sec accuracy=0.856641 cross-entropy=0.411392
INFO:root:Epoch[24] Batch [180] Speed: 4189.37 samples/sec accuracy=0.859375 cross-entropy=0.392605
INFO:root:Epoch[24] Batch [200] Speed: 4103.24 samples/sec accuracy=0.848437 cross-entropy=0.446472
INFO:root:Epoch[24] Batch [220] Speed: 4186.15 samples/sec accuracy=0.858203 cross-entropy=0.410904
INFO:root:Epoch[24] Batch [240] Speed: 3941.40 samples/sec accuracy=0.861719 cross-entropy=0.412118
INFO:root:Epoch[24] Batch [260] Speed: 3955.50 samples/sec accuracy=0.858203 cross-entropy=0.416907
INFO:root:Epoch[24] Batch [280] Speed: 4064.14 samples/sec accuracy=0.848437 cross-entropy=0.442604
INFO:root:Epoch[24] Batch [300] Speed: 4065.34 samples/sec accuracy=0.859375 cross-entropy=0.418555
INFO:root:Epoch[24] Batch [320] Speed: 4027.25 samples/sec accuracy=0.853125 cross-entropy=0.435238
INFO:root:Epoch[24] Batch [340] Speed: 4125.71 samples/sec accuracy=0.867578 cross-entropy=0.394804
INFO:root:Epoch[24] Batch [360] Speed: 4160.27 samples/sec accuracy=0.880078 cross-entropy=0.362275
INFO:root:Epoch[24] Batch [380] Speed: 4127.83 samples/sec accuracy=0.851562 cross-entropy=0.413768
INFO:root:Epoch[24] Train-accuracy=0.860156
INFO:root:Epoch[24] Train-cross-entropy=0.411564
INFO:root:Epoch[24] Time cost=12.317
INFO:root:Epoch[24] Validation-accuracy=0.834652
INFO:root:Epoch[24] Validation-cross-entropy=0.513073
INFO:root:Epoch[25] Batch [20] Speed: 4089.65 samples/sec accuracy=0.842262 cross-entropy=0.418305
INFO:root:Epoch[25] Batch [40] Speed: 4208.51 samples/sec accuracy=0.856641 cross-entropy=0.422396
INFO:root:Epoch[25] Batch [60] Speed: 4107.61 samples/sec accuracy=0.848828 cross-entropy=0.436451
INFO:root:Epoch[25] Batch [80] Speed: 4232.62 samples/sec accuracy=0.860938 cross-entropy=0.407233
INFO:root:Epoch[25] Batch [100] Speed: 4122.27 samples/sec accuracy=0.854297 cross-entropy=0.443589
INFO:root:Epoch[25] Batch [120] Speed: 4223.64 samples/sec accuracy=0.842578 cross-entropy=0.442979
INFO:root:Epoch[25] Batch [140] Speed: 3983.54 samples/sec accuracy=0.854297 cross-entropy=0.424340
INFO:root:Epoch[25] Batch [160] Speed: 4065.84 samples/sec accuracy=0.848047 cross-entropy=0.444726
INFO:root:Epoch[25] Batch [180] Speed: 4058.24 samples/sec accuracy=0.848437 cross-entropy=0.441291
INFO:root:Epoch[25] Batch [200] Speed: 4150.43 samples/sec accuracy=0.852344 cross-entropy=0.440430
INFO:root:Epoch[25] Batch [220] Speed: 4117.21 samples/sec accuracy=0.864062 cross-entropy=0.421728
INFO:root:Epoch[25] Batch [240] Speed: 4224.89 samples/sec accuracy=0.860156 cross-entropy=0.406004
INFO:root:Epoch[25] Batch [260] Speed: 4160.29 samples/sec accuracy=0.850781 cross-entropy=0.409795
INFO:root:Epoch[25] Batch [280] Speed: 4170.64 samples/sec accuracy=0.853516 cross-entropy=0.424069
INFO:root:Epoch[25] Batch [300] Speed: 4208.86 samples/sec accuracy=0.843359 cross-entropy=0.435568
INFO:root:Epoch[25] Batch [320] Speed: 4113.01 samples/sec accuracy=0.861328 cross-entropy=0.427530
INFO:root:Epoch[25] Batch [340] Speed: 4169.38 samples/sec accuracy=0.866797 cross-entropy=0.387489
INFO:root:Epoch[25] Batch [360] Speed: 4248.31 samples/sec accuracy=0.855469 cross-entropy=0.417263
INFO:root:Epoch[25] Batch [380] Speed: 4206.01 samples/sec accuracy=0.855078 cross-entropy=0.414175
INFO:root:Epoch[25] Train-accuracy=0.853906
INFO:root:Epoch[25] Train-cross-entropy=0.433782
INFO:root:Epoch[25] Time cost=12.050
INFO:root:Epoch[25] Validation-accuracy=0.853466
INFO:root:Epoch[25] Validation-cross-entropy=0.454320
INFO:root:Epoch[26] Batch [20] Speed: 4204.95 samples/sec accuracy=0.853795 cross-entropy=0.405921
INFO:root:Epoch[26] Batch [40] Speed: 4169.77 samples/sec accuracy=0.864844 cross-entropy=0.415948
INFO:root:Epoch[26] Batch [60] Speed: 4115.80 samples/sec accuracy=0.851172 cross-entropy=0.440945
INFO:root:Epoch[26] Batch [80] Speed: 4062.50 samples/sec accuracy=0.858594 cross-entropy=0.426338
INFO:root:Epoch[26] Batch [100] Speed: 4122.32 samples/sec accuracy=0.858984 cross-entropy=0.430394
INFO:root:Epoch[26] Batch [120] Speed: 4079.81 samples/sec accuracy=0.856641 cross-entropy=0.414668
INFO:root:Epoch[26] Batch [140] Speed: 4109.32 samples/sec accuracy=0.857422 cross-entropy=0.420330
INFO:root:Epoch[26] Batch [160] Speed: 4161.63 samples/sec accuracy=0.855469 cross-entropy=0.424862
INFO:root:Epoch[26] Batch [180] Speed: 4052.49 samples/sec accuracy=0.853125 cross-entropy=0.409256
INFO:root:Epoch[26] Batch [200] Speed: 3839.21 samples/sec accuracy=0.852734 cross-entropy=0.423417
INFO:root:Epoch[26] Batch [220] Speed: 4019.15 samples/sec accuracy=0.856250 cross-entropy=0.427014
INFO:root:Epoch[26] Batch [240] Speed: 4076.28 samples/sec accuracy=0.871484 cross-entropy=0.385059
INFO:root:Epoch[26] Batch [260] Speed: 4157.37 samples/sec accuracy=0.860547 cross-entropy=0.409267
INFO:root:Epoch[26] Batch [280] Speed: 4154.89 samples/sec accuracy=0.851953 cross-entropy=0.430169
INFO:root:Epoch[26] Batch [300] Speed: 4088.48 samples/sec accuracy=0.858203 cross-entropy=0.413244
INFO:root:Epoch[26] Batch [320] Speed: 4147.06 samples/sec accuracy=0.859375 cross-entropy=0.396659
INFO:root:Epoch[26] Batch [340] Speed: 4036.56 samples/sec accuracy=0.864453 cross-entropy=0.406061
INFO:root:Epoch[26] Batch [360] Speed: 4161.80 samples/sec accuracy=0.862891 cross-entropy=0.390572
INFO:root:Epoch[26] Batch [380] Speed: 3973.74 samples/sec accuracy=0.864062 cross-entropy=0.404937
INFO:root:Epoch[26] Train-accuracy=0.857639
INFO:root:Epoch[26] Train-cross-entropy=0.416188
INFO:root:Epoch[26] Time cost=12.188
INFO:root:Epoch[26] Validation-accuracy=0.855168
INFO:root:Epoch[26] Validation-cross-entropy=0.433195
INFO:root:Epoch[27] Batch [20] Speed: 4118.97 samples/sec accuracy=0.853423 cross-entropy=0.416161
INFO:root:Epoch[27] Batch [40] Speed: 4066.32 samples/sec accuracy=0.860547 cross-entropy=0.407201
INFO:root:Epoch[27] Batch [60] Speed: 4067.08 samples/sec accuracy=0.852344 cross-entropy=0.429848
INFO:root:Epoch[27] Batch [80] Speed: 4170.92 samples/sec accuracy=0.858594 cross-entropy=0.405155
INFO:root:Epoch[27] Batch [100] Speed: 4085.54 samples/sec accuracy=0.850391 cross-entropy=0.433648
INFO:root:Epoch[27] Batch [120] Speed: 4129.46 samples/sec accuracy=0.862500 cross-entropy=0.407070
INFO:root:Epoch[27] Batch [140] Speed: 4206.39 samples/sec accuracy=0.851562 cross-entropy=0.407290
INFO:root:Epoch[27] Batch [160] Speed: 4124.72 samples/sec accuracy=0.857422 cross-entropy=0.383101
INFO:root:Epoch[27] Batch [180] Speed: 4109.11 samples/sec accuracy=0.868359 cross-entropy=0.385390
INFO:root:Epoch[27] Batch [200] Speed: 4079.30 samples/sec accuracy=0.862891 cross-entropy=0.399944
INFO:root:Epoch[27] Batch [220] Speed: 4153.08 samples/sec accuracy=0.853906 cross-entropy=0.412093
INFO:root:Epoch[27] Batch [240] Speed: 4147.14 samples/sec accuracy=0.862500 cross-entropy=0.395543
INFO:root:Epoch[27] Batch [260] Speed: 4211.94 samples/sec accuracy=0.856641 cross-entropy=0.401267
INFO:root:Epoch[27] Batch [280] Speed: 4093.54 samples/sec accuracy=0.852344 cross-entropy=0.422689
INFO:root:Epoch[27] Batch [300] Speed: 4165.13 samples/sec accuracy=0.855078 cross-entropy=0.420187
INFO:root:Epoch[27] Batch [320] Speed: 4139.95 samples/sec accuracy=0.872266 cross-entropy=0.385427
INFO:root:Epoch[27] Batch [340] Speed: 4081.20 samples/sec accuracy=0.857422 cross-entropy=0.411825
INFO:root:Epoch[27] Batch [360] Speed: 4099.34 samples/sec accuracy=0.866406 cross-entropy=0.382105
INFO:root:Epoch[27] Batch [380] Speed: 4172.01 samples/sec accuracy=0.862109 cross-entropy=0.398713
INFO:root:Epoch[27] Train-accuracy=0.853906
INFO:root:Epoch[27] Train-cross-entropy=0.440340
INFO:root:Epoch[27] Time cost=12.112
INFO:root:Epoch[27] Validation-accuracy=0.845954
INFO:root:Epoch[27] Validation-cross-entropy=0.463525
INFO:root:Epoch[28] Batch [20] Speed: 4204.48 samples/sec accuracy=0.861235 cross-entropy=0.405043
INFO:root:Epoch[28] Batch [40] Speed: 4156.83 samples/sec accuracy=0.868359 cross-entropy=0.386754
INFO:root:Epoch[28] Batch [60] Speed: 4066.47 samples/sec accuracy=0.860156 cross-entropy=0.415741
INFO:root:Epoch[28] Batch [80] Speed: 4105.85 samples/sec accuracy=0.858594 cross-entropy=0.399488
INFO:root:Epoch[28] Batch [100] Speed: 4138.37 samples/sec accuracy=0.859375 cross-entropy=0.394413
INFO:root:Epoch[28] Batch [120] Speed: 4126.82 samples/sec accuracy=0.866797 cross-entropy=0.402923
INFO:root:Epoch[28] Batch [140] Speed: 4172.66 samples/sec accuracy=0.853125 cross-entropy=0.408925
INFO:root:Epoch[28] Batch [160] Speed: 4208.93 samples/sec accuracy=0.841016 cross-entropy=0.433131
INFO:root:Epoch[28] Batch [180] Speed: 4157.39 samples/sec accuracy=0.863672 cross-entropy=0.386301
INFO:root:Epoch[28] Batch [200] Speed: 4188.23 samples/sec accuracy=0.841016 cross-entropy=0.445458
INFO:root:Epoch[28] Batch [220] Speed: 4165.66 samples/sec accuracy=0.856641 cross-entropy=0.410340
INFO:root:Epoch[28] Batch [240] Speed: 4232.06 samples/sec accuracy=0.863281 cross-entropy=0.399350
INFO:root:Epoch[28] Batch [260] Speed: 4152.84 samples/sec accuracy=0.862109 cross-entropy=0.400865
INFO:root:Epoch[28] Batch [280] Speed: 4124.57 samples/sec accuracy=0.857422 cross-entropy=0.400589
INFO:root:Epoch[28] Batch [300] Speed: 4051.10 samples/sec accuracy=0.862109 cross-entropy=0.401012
INFO:root:Epoch[28] Batch [320] Speed: 4106.50 samples/sec accuracy=0.855078 cross-entropy=0.402327
INFO:root:Epoch[28] Batch [340] Speed: 4094.92 samples/sec accuracy=0.864062 cross-entropy=0.401718
INFO:root:Epoch[28] Batch [360] Speed: 4081.37 samples/sec accuracy=0.874219 cross-entropy=0.369839
INFO:root:Epoch[28] Batch [380] Speed: 4192.03 samples/sec accuracy=0.861328 cross-entropy=0.407292
INFO:root:Epoch[28] Train-accuracy=0.873437
INFO:root:Epoch[28] Train-cross-entropy=0.374311
INFO:root:Epoch[28] Time cost=12.062
INFO:root:Epoch[28] Validation-accuracy=0.846254
INFO:root:Epoch[28] Validation-cross-entropy=0.469231
INFO:root:Epoch[29] Batch [20] Speed: 4116.72 samples/sec accuracy=0.867188 cross-entropy=0.391862
INFO:root:Epoch[29] Batch [40] Speed: 4216.31 samples/sec accuracy=0.860156 cross-entropy=0.405470
INFO:root:Epoch[29] Batch [60] Speed: 4178.36 samples/sec accuracy=0.859766 cross-entropy=0.406723
INFO:root:Epoch[29] Batch [80] Speed: 4139.23 samples/sec accuracy=0.876953 cross-entropy=0.380137
INFO:root:Epoch[29] Batch [100] Speed: 4168.21 samples/sec accuracy=0.862891 cross-entropy=0.402279
INFO:root:Epoch[29] Batch [120] Speed: 4151.44 samples/sec accuracy=0.864062 cross-entropy=0.389691
INFO:root:Epoch[29] Batch [140] Speed: 4054.55 samples/sec accuracy=0.857812 cross-entropy=0.398776
INFO:root:Epoch[29] Batch [160] Speed: 4088.16 samples/sec accuracy=0.847656 cross-entropy=0.420177
INFO:root:Epoch[29] Batch [180] Speed: 4135.20 samples/sec accuracy=0.857422 cross-entropy=0.404351
INFO:root:Epoch[29] Batch [200] Speed: 4186.04 samples/sec accuracy=0.860938 cross-entropy=0.414858
INFO:root:Epoch[29] Batch [220] Speed: 4187.74 samples/sec accuracy=0.865625 cross-entropy=0.400629
INFO:root:Epoch[29] Batch [240] Speed: 4089.55 samples/sec accuracy=0.868750 cross-entropy=0.390428
INFO:root:Epoch[29] Batch [260] Speed: 3954.27 samples/sec accuracy=0.866797 cross-entropy=0.387028
INFO:root:Epoch[29] Batch [280] Speed: 4055.65 samples/sec accuracy=0.864453 cross-entropy=0.388661
INFO:root:Epoch[29] Batch [300] Speed: 4059.46 samples/sec accuracy=0.866406 cross-entropy=0.392460
INFO:root:Epoch[29] Batch [320] Speed: 4104.51 samples/sec accuracy=0.856641 cross-entropy=0.406298
INFO:root:Epoch[29] Batch [340] Speed: 4141.95 samples/sec accuracy=0.872266 cross-entropy=0.382248
INFO:root:Epoch[29] Batch [360] Speed: 4201.33 samples/sec accuracy=0.865234 cross-entropy=0.377375
INFO:root:Epoch[29] Batch [380] Speed: 4174.16 samples/sec accuracy=0.864844 cross-entropy=0.407931
INFO:root:Epoch[29] Train-accuracy=0.862847
INFO:root:Epoch[29] Train-cross-entropy=0.388414
INFO:root:Epoch[29] Time cost=12.079
INFO:root:Epoch[29] Validation-accuracy=0.847556
INFO:root:Epoch[29] Validation-cross-entropy=0.457724
INFO:root:Epoch[30] Batch [20] Speed: 4236.23 samples/sec accuracy=0.865699 cross-entropy=0.382808
INFO:root:Epoch[30] Batch [40] Speed: 4104.36 samples/sec accuracy=0.856641 cross-entropy=0.400389
INFO:root:Epoch[30] Batch [60] Speed: 4007.53 samples/sec accuracy=0.858984 cross-entropy=0.415463
INFO:root:Epoch[30] Batch [80] Speed: 4180.99 samples/sec accuracy=0.867578 cross-entropy=0.393589
INFO:root:Epoch[30] Batch [100] Speed: 4184.53 samples/sec accuracy=0.862500 cross-entropy=0.409937
INFO:root:Epoch[30] Batch [120] Speed: 4040.76 samples/sec accuracy=0.855859 cross-entropy=0.406204
INFO:root:Epoch[30] Batch [140] Speed: 4050.95 samples/sec accuracy=0.868359 cross-entropy=0.391954
INFO:root:Epoch[30] Batch [160] Speed: 4181.43 samples/sec accuracy=0.855078 cross-entropy=0.423249
INFO:root:Epoch[30] Batch [180] Speed: 4217.91 samples/sec accuracy=0.866406 cross-entropy=0.384466
INFO:root:Epoch[30] Batch [200] Speed: 4134.45 samples/sec accuracy=0.855859 cross-entropy=0.431726
INFO:root:Epoch[30] Batch [220] Speed: 4119.19 samples/sec accuracy=0.874609 cross-entropy=0.361546
INFO:root:Epoch[30] Batch [240] Speed: 4184.24 samples/sec accuracy=0.867578 cross-entropy=0.376047
INFO:root:Epoch[30] Batch [260] Speed: 4197.62 samples/sec accuracy=0.866016 cross-entropy=0.387000
INFO:root:Epoch[30] Batch [280] Speed: 4186.58 samples/sec accuracy=0.864844 cross-entropy=0.389576
INFO:root:Epoch[30] Batch [300] Speed: 4164.88 samples/sec accuracy=0.857422 cross-entropy=0.407554
INFO:root:Epoch[30] Batch [320] Speed: 4188.25 samples/sec accuracy=0.860938 cross-entropy=0.402441
INFO:root:Epoch[30] Batch [340] Speed: 4142.17 samples/sec accuracy=0.867188 cross-entropy=0.392143
INFO:root:Epoch[30] Batch [360] Speed: 4142.23 samples/sec accuracy=0.863281 cross-entropy=0.390919
INFO:root:Epoch[30] Batch [380] Speed: 4168.78 samples/sec accuracy=0.861328 cross-entropy=0.381728
INFO:root:Epoch[30] Train-accuracy=0.876563
INFO:root:Epoch[30] Train-cross-entropy=0.370877
INFO:root:Epoch[30] Time cost=12.073
INFO:root:Epoch[30] Validation-accuracy=0.852865
INFO:root:Epoch[30] Validation-cross-entropy=0.434213
INFO:root:Epoch[31] Batch [20] Speed: 4077.46 samples/sec accuracy=0.866071 cross-entropy=0.377265
INFO:root:Epoch[31] Batch [40] Speed: 4020.00 samples/sec accuracy=0.863281 cross-entropy=0.391993
INFO:root:Epoch[31] Batch [60] Speed: 4082.73 samples/sec accuracy=0.863281 cross-entropy=0.387137
INFO:root:Epoch[31] Batch [80] Speed: 4100.80 samples/sec accuracy=0.867578 cross-entropy=0.384210
INFO:root:Epoch[31] Batch [100] Speed: 4181.58 samples/sec accuracy=0.861719 cross-entropy=0.396347
INFO:root:Epoch[31] Batch [120] Speed: 4165.69 samples/sec accuracy=0.859766 cross-entropy=0.389001
INFO:root:Epoch[31] Batch [140] Speed: 4159.93 samples/sec accuracy=0.865625 cross-entropy=0.400187
INFO:root:Epoch[31] Batch [160] Speed: 4102.76 samples/sec accuracy=0.851172 cross-entropy=0.412669
INFO:root:Epoch[31] Batch [180] Speed: 4159.01 samples/sec accuracy=0.871484 cross-entropy=0.366797
INFO:root:Epoch[31] Batch [200] Speed: 4134.48 samples/sec accuracy=0.859766 cross-entropy=0.392861
INFO:root:Epoch[31] Batch [220] Speed: 4080.42 samples/sec accuracy=0.861328 cross-entropy=0.395948
INFO:root:Epoch[31] Batch [240] Speed: 4128.16 samples/sec accuracy=0.866406 cross-entropy=0.386198
INFO:root:Epoch[31] Batch [260] Speed: 4117.53 samples/sec accuracy=0.871484 cross-entropy=0.364619
INFO:root:Epoch[31] Batch [280] Speed: 4115.82 samples/sec accuracy=0.846875 cross-entropy=0.435088
INFO:root:Epoch[31] Batch [300] Speed: 4093.78 samples/sec accuracy=0.869141 cross-entropy=0.377149
INFO:root:Epoch[31] Batch [320] Speed: 3961.90 samples/sec accuracy=0.866406 cross-entropy=0.385061
INFO:root:Epoch[31] Batch [340] Speed: 4156.86 samples/sec accuracy=0.873047 cross-entropy=0.355324
INFO:root:Epoch[31] Batch [360] Speed: 4129.98 samples/sec accuracy=0.864062 cross-entropy=0.364872
INFO:root:Epoch[31] Batch [380] Speed: 4110.33 samples/sec accuracy=0.860547 cross-entropy=0.388631
INFO:root:Epoch[31] Train-accuracy=0.870660
INFO:root:Epoch[31] Train-cross-entropy=0.377296
INFO:root:Epoch[31] Time cost=12.152
INFO:root:Epoch[31] Validation-accuracy=0.850260
INFO:root:Epoch[31] Validation-cross-entropy=0.442736
INFO:root:Epoch[32] Batch [20] Speed: 4098.72 samples/sec accuracy=0.866071 cross-entropy=0.391811
INFO:root:Epoch[32] Batch [40] Speed: 4102.25 samples/sec accuracy=0.871094 cross-entropy=0.369529
INFO:root:Epoch[32] Batch [60] Speed: 4212.63 samples/sec accuracy=0.860156 cross-entropy=0.398124
INFO:root:Epoch[32] Batch [80] Speed: 4102.52 samples/sec accuracy=0.871484 cross-entropy=0.392118
INFO:root:Epoch[32] Batch [100] Speed: 4191.74 samples/sec accuracy=0.867969 cross-entropy=0.399035
INFO:root:Epoch[32] Batch [120] Speed: 4088.49 samples/sec accuracy=0.870313 cross-entropy=0.382496
INFO:root:Epoch[32] Batch [140] Speed: 3932.00 samples/sec accuracy=0.875391 cross-entropy=0.365292
INFO:root:Epoch[32] Batch [160] Speed: 3977.99 samples/sec accuracy=0.862891 cross-entropy=0.380245
INFO:root:Epoch[32] Batch [180] Speed: 4090.98 samples/sec accuracy=0.875000 cross-entropy=0.359577
INFO:root:Epoch[32] Batch [200] Speed: 3895.59 samples/sec accuracy=0.862109 cross-entropy=0.407083
INFO:root:Epoch[32] Batch [220] Speed: 4037.62 samples/sec accuracy=0.870703 cross-entropy=0.390574
INFO:root:Epoch[32] Batch [240] Speed: 4166.58 samples/sec accuracy=0.874219 cross-entropy=0.369496
INFO:root:Epoch[32] Batch [260] Speed: 4159.06 samples/sec accuracy=0.860156 cross-entropy=0.405273
INFO:root:Epoch[32] Batch [280] Speed: 4157.51 samples/sec accuracy=0.864453 cross-entropy=0.386991
INFO:root:Epoch[32] Batch [300] Speed: 4103.29 samples/sec accuracy=0.867578 cross-entropy=0.385064
INFO:root:Epoch[32] Batch [320] Speed: 4137.56 samples/sec accuracy=0.862109 cross-entropy=0.398312
INFO:root:Epoch[32] Batch [340] Speed: 4111.78 samples/sec accuracy=0.871094 cross-entropy=0.373936
INFO:root:Epoch[32] Batch [360] Speed: 4200.25 samples/sec accuracy=0.884375 cross-entropy=0.344612
INFO:root:Epoch[32] Batch [380] Speed: 4181.57 samples/sec accuracy=0.868359 cross-entropy=0.380493
INFO:root:Epoch[32] Train-accuracy=0.878125
INFO:root:Epoch[32] Train-cross-entropy=0.381484
INFO:root:Epoch[32] Time cost=12.243
INFO:root:Epoch[32] Validation-accuracy=0.857100
INFO:root:Epoch[32] Validation-cross-entropy=0.425131
INFO:root:Epoch[33] Batch [20] Speed: 4191.27 samples/sec accuracy=0.862351 cross-entropy=0.386246
INFO:root:Epoch[33] Batch [40] Speed: 4157.19 samples/sec accuracy=0.869922 cross-entropy=0.374709
INFO:root:Epoch[33] Batch [60] Speed: 4066.40 samples/sec accuracy=0.866016 cross-entropy=0.399253
INFO:root:Epoch[33] Batch [80] Speed: 4127.78 samples/sec accuracy=0.866016 cross-entropy=0.394187
INFO:root:Epoch[33] Batch [100] Speed: 4183.74 samples/sec accuracy=0.867578 cross-entropy=0.396557
INFO:root:Epoch[33] Batch [120] Speed: 4130.64 samples/sec accuracy=0.861719 cross-entropy=0.381165
INFO:root:Epoch[33] Batch [140] Speed: 4009.40 samples/sec accuracy=0.854297 cross-entropy=0.419348
INFO:root:Epoch[33] Batch [160] Speed: 4084.95 samples/sec accuracy=0.857031 cross-entropy=0.398459
INFO:root:Epoch[33] Batch [180] Speed: 4047.22 samples/sec accuracy=0.872656 cross-entropy=0.360689
INFO:root:Epoch[33] Batch [200] Speed: 4187.95 samples/sec accuracy=0.872266 cross-entropy=0.372164
INFO:root:Epoch[33] Batch [220] Speed: 4129.10 samples/sec accuracy=0.875000 cross-entropy=0.364843
INFO:root:Epoch[33] Batch [240] Speed: 4005.87 samples/sec accuracy=0.873437 cross-entropy=0.357368
INFO:root:Epoch[33] Batch [260] Speed: 4096.01 samples/sec accuracy=0.874609 cross-entropy=0.363007
INFO:root:Epoch[33] Batch [280] Speed: 4155.23 samples/sec accuracy=0.852344 cross-entropy=0.407506
INFO:root:Epoch[33] Batch [300] Speed: 4043.23 samples/sec accuracy=0.860547 cross-entropy=0.397567
INFO:root:Epoch[33] Batch [320] Speed: 4034.93 samples/sec accuracy=0.858203 cross-entropy=0.399473
INFO:root:Epoch[33] Batch [340] Speed: 4093.07 samples/sec accuracy=0.872656 cross-entropy=0.376010
INFO:root:Epoch[33] Batch [360] Speed: 4076.65 samples/sec accuracy=0.876953 cross-entropy=0.347621
INFO:root:Epoch[33] Batch [380] Speed: 4119.17 samples/sec accuracy=0.866797 cross-entropy=0.386688
INFO:root:Epoch[33] Train-accuracy=0.890625
INFO:root:Epoch[33] Train-cross-entropy=0.325198
INFO:root:Epoch[33] Time cost=12.211
INFO:root:Epoch[33] Validation-accuracy=0.860777
INFO:root:Epoch[33] Validation-cross-entropy=0.424044
INFO:root:Epoch[34] Batch [20] Speed: 4107.55 samples/sec accuracy=0.867932 cross-entropy=0.384326
INFO:root:Epoch[34] Batch [40] Speed: 4133.33 samples/sec accuracy=0.870703 cross-entropy=0.377293
INFO:root:Epoch[34] Batch [60] Speed: 4208.02 samples/sec accuracy=0.868750 cross-entropy=0.377694
INFO:root:Epoch[34] Batch [80] Speed: 4099.65 samples/sec accuracy=0.878125 cross-entropy=0.369829
INFO:root:Epoch[34] Batch [100] Speed: 4148.67 samples/sec accuracy=0.876172 cross-entropy=0.375629
INFO:root:Epoch[34] Batch [120] Speed: 4151.44 samples/sec accuracy=0.870703 cross-entropy=0.376514
INFO:root:Epoch[34] Batch [140] Speed: 4216.44 samples/sec accuracy=0.876563 cross-entropy=0.362011
INFO:root:Epoch[34] Batch [160] Speed: 4161.76 samples/sec accuracy=0.871484 cross-entropy=0.368486
INFO:root:Epoch[34] Batch [180] Speed: 4135.77 samples/sec accuracy=0.866797 cross-entropy=0.370466
INFO:root:Epoch[34] Batch [200] Speed: 4108.27 samples/sec accuracy=0.867578 cross-entropy=0.381019
INFO:root:Epoch[34] Batch [220] Speed: 4146.78 samples/sec accuracy=0.875781 cross-entropy=0.371210
INFO:root:Epoch[34] Batch [240] Speed: 4120.13 samples/sec accuracy=0.862500 cross-entropy=0.368066
INFO:root:Epoch[34] Batch [260] Speed: 4164.56 samples/sec accuracy=0.865234 cross-entropy=0.364357
INFO:root:Epoch[34] Batch [280] Speed: 4232.55 samples/sec accuracy=0.877344 cross-entropy=0.351048
INFO:root:Epoch[34] Batch [300] Speed: 4126.42 samples/sec accuracy=0.859375 cross-entropy=0.406177
INFO:root:Epoch[34] Batch [320] Speed: 4172.29 samples/sec accuracy=0.868359 cross-entropy=0.393229
INFO:root:Epoch[34] Batch [340] Speed: 4132.84 samples/sec accuracy=0.871094 cross-entropy=0.359085
INFO:root:Epoch[34] Batch [360] Speed: 4196.61 samples/sec accuracy=0.878906 cross-entropy=0.348948
INFO:root:Epoch[34] Batch [380] Speed: 4176.48 samples/sec accuracy=0.874219 cross-entropy=0.363651
INFO:root:Epoch[34] Train-accuracy=0.862847
INFO:root:Epoch[34] Train-cross-entropy=0.391344
INFO:root:Epoch[34] Time cost=12.011
INFO:root:Epoch[34] Validation-accuracy=0.832532
INFO:root:Epoch[34] Validation-cross-entropy=0.516136
INFO:root:Epoch[35] Batch [20] Speed: 4142.08 samples/sec accuracy=0.853423 cross-entropy=0.407376
INFO:root:Epoch[35] Batch [40] Speed: 4145.92 samples/sec accuracy=0.867578 cross-entropy=0.389944
INFO:root:Epoch[35] Batch [60] Speed: 4159.77 samples/sec accuracy=0.871484 cross-entropy=0.364992
INFO:root:Epoch[35] Batch [80] Speed: 4058.08 samples/sec accuracy=0.873828 cross-entropy=0.377888
INFO:root:Epoch[35] Batch [100] Speed: 4118.34 samples/sec accuracy=0.864453 cross-entropy=0.395750
INFO:root:Epoch[35] Batch [120] Speed: 4149.26 samples/sec accuracy=0.873828 cross-entropy=0.356883
INFO:root:Epoch[35] Batch [140] Speed: 4199.49 samples/sec accuracy=0.862500 cross-entropy=0.385156
INFO:root:Epoch[35] Batch [160] Speed: 4155.58 samples/sec accuracy=0.876172 cross-entropy=0.358810
INFO:root:Epoch[35] Batch [180] Speed: 4105.99 samples/sec accuracy=0.875000 cross-entropy=0.351376
INFO:root:Epoch[35] Batch [200] Speed: 4130.24 samples/sec accuracy=0.872266 cross-entropy=0.384349
INFO:root:Epoch[35] Batch [220] Speed: 3934.47 samples/sec accuracy=0.870703 cross-entropy=0.370196
INFO:root:Epoch[35] Batch [240] Speed: 4157.45 samples/sec accuracy=0.876563 cross-entropy=0.339404
INFO:root:Epoch[35] Batch [260] Speed: 4099.17 samples/sec accuracy=0.876563 cross-entropy=0.359134
INFO:root:Epoch[35] Batch [280] Speed: 4162.04 samples/sec accuracy=0.862109 cross-entropy=0.392390
INFO:root:Epoch[35] Batch [300] Speed: 4168.49 samples/sec accuracy=0.862500 cross-entropy=0.382209
INFO:root:Epoch[35] Batch [320] Speed: 4145.84 samples/sec accuracy=0.870703 cross-entropy=0.376980
INFO:root:Epoch[35] Batch [340] Speed: 4138.98 samples/sec accuracy=0.861719 cross-entropy=0.383242
INFO:root:Epoch[35] Batch [360] Speed: 4092.52 samples/sec accuracy=0.892188 cross-entropy=0.323289
INFO:root:Epoch[35] Batch [380] Speed: 4186.15 samples/sec accuracy=0.871484 cross-entropy=0.369859
INFO:root:Epoch[35] Train-accuracy=0.871094
INFO:root:Epoch[35] Train-cross-entropy=0.376984
INFO:root:Epoch[35] Time cost=12.117
INFO:root:Epoch[35] Validation-accuracy=0.863782
INFO:root:Epoch[35] Validation-cross-entropy=0.398332
INFO:root:Epoch[36] Batch [20] Speed: 4190.43 samples/sec accuracy=0.875744 cross-entropy=0.341081
INFO:root:Epoch[36] Batch [40] Speed: 4048.62 samples/sec accuracy=0.882812 cross-entropy=0.346945
INFO:root:Epoch[36] Batch [60] Speed: 4158.67 samples/sec accuracy=0.867188 cross-entropy=0.373640
INFO:root:Epoch[36] Batch [80] Speed: 4147.30 samples/sec accuracy=0.870313 cross-entropy=0.379217
INFO:root:Epoch[36] Batch [100] Speed: 4136.76 samples/sec accuracy=0.862891 cross-entropy=0.400289
INFO:root:Epoch[36] Batch [120] Speed: 4119.01 samples/sec accuracy=0.872266 cross-entropy=0.360634
INFO:root:Epoch[36] Batch [140] Speed: 4159.58 samples/sec accuracy=0.877344 cross-entropy=0.365654
INFO:root:Epoch[36] Batch [160] Speed: 4121.65 samples/sec accuracy=0.858984 cross-entropy=0.387205
INFO:root:Epoch[36] Batch [180] Speed: 4168.08 samples/sec accuracy=0.886328 cross-entropy=0.342930
INFO:root:Epoch[36] Batch [200] Speed: 4110.30 samples/sec accuracy=0.874219 cross-entropy=0.357847
INFO:root:Epoch[36] Batch [220] Speed: 4063.63 samples/sec accuracy=0.869922 cross-entropy=0.392434
INFO:root:Epoch[36] Batch [240] Speed: 4202.61 samples/sec accuracy=0.868750 cross-entropy=0.363398
INFO:root:Epoch[36] Batch [260] Speed: 4096.90 samples/sec accuracy=0.872656 cross-entropy=0.372288
INFO:root:Epoch[36] Batch [280] Speed: 4151.15 samples/sec accuracy=0.876563 cross-entropy=0.356856
INFO:root:Epoch[36] Batch [300] Speed: 4118.27 samples/sec accuracy=0.870313 cross-entropy=0.368592
INFO:root:Epoch[36] Batch [320] Speed: 4013.26 samples/sec accuracy=0.883203 cross-entropy=0.351504
INFO:root:Epoch[36] Batch [340] Speed: 4065.56 samples/sec accuracy=0.873828 cross-entropy=0.340355
INFO:root:Epoch[36] Batch [360] Speed: 4147.54 samples/sec accuracy=0.875000 cross-entropy=0.374526
INFO:root:Epoch[36] Batch [380] Speed: 4165.01 samples/sec accuracy=0.880078 cross-entropy=0.343332
INFO:root:Epoch[36] Train-accuracy=0.875000
INFO:root:Epoch[36] Train-cross-entropy=0.350816
INFO:root:Epoch[36] Time cost=12.129
INFO:root:Epoch[36] Validation-accuracy=0.853966
INFO:root:Epoch[36] Validation-cross-entropy=0.448527
INFO:root:Epoch[37] Batch [20] Speed: 4141.72 samples/sec accuracy=0.867188 cross-entropy=0.377639
INFO:root:Epoch[37] Batch [40] Speed: 4162.74 samples/sec accuracy=0.876563 cross-entropy=0.359693
INFO:root:Epoch[37] Batch [60] Speed: 4127.93 samples/sec accuracy=0.857422 cross-entropy=0.399482
INFO:root:Epoch[37] Batch [80] Speed: 4177.21 samples/sec accuracy=0.870703 cross-entropy=0.359105
INFO:root:Epoch[37] Batch [100] Speed: 4064.05 samples/sec accuracy=0.872656 cross-entropy=0.370785
INFO:root:Epoch[37] Batch [120] Speed: 4043.50 samples/sec accuracy=0.867969 cross-entropy=0.368148
INFO:root:Epoch[37] Batch [140] Speed: 4164.89 samples/sec accuracy=0.876953 cross-entropy=0.349841
INFO:root:Epoch[37] Batch [160] Speed: 4173.63 samples/sec accuracy=0.866797 cross-entropy=0.383218
INFO:root:Epoch[37] Batch [180] Speed: 4179.80 samples/sec accuracy=0.872656 cross-entropy=0.349744
INFO:root:Epoch[37] Batch [200] Speed: 3980.16 samples/sec accuracy=0.867969 cross-entropy=0.381489
INFO:root:Epoch[37] Batch [220] Speed: 4096.90 samples/sec accuracy=0.872656 cross-entropy=0.368665
INFO:root:Epoch[37] Batch [240] Speed: 4221.93 samples/sec accuracy=0.871875 cross-entropy=0.367096
INFO:root:Epoch[37] Batch [260] Speed: 4157.75 samples/sec accuracy=0.877344 cross-entropy=0.350965
INFO:root:Epoch[37] Batch [280] Speed: 4180.29 samples/sec accuracy=0.871094 cross-entropy=0.365340
INFO:root:Epoch[37] Batch [300] Speed: 4050.51 samples/sec accuracy=0.879297 cross-entropy=0.355279
INFO:root:Epoch[37] Batch [320] Speed: 4109.93 samples/sec accuracy=0.878516 cross-entropy=0.352396
INFO:root:Epoch[37] Batch [340] Speed: 4139.67 samples/sec accuracy=0.873047 cross-entropy=0.364963
INFO:root:Epoch[37] Batch [360] Speed: 4104.12 samples/sec accuracy=0.883984 cross-entropy=0.338831
INFO:root:Epoch[37] Batch [380] Speed: 4109.09 samples/sec accuracy=0.879687 cross-entropy=0.352623
INFO:root:Epoch[37] Train-accuracy=0.879340
INFO:root:Epoch[37] Train-cross-entropy=0.341990
INFO:root:Epoch[37] Time cost=12.087
INFO:root:Epoch[37] Validation-accuracy=0.853966
INFO:root:Epoch[37] Validation-cross-entropy=0.447071
INFO:root:Epoch[38] Batch [20] Speed: 4168.07 samples/sec accuracy=0.872024 cross-entropy=0.357152
INFO:root:Epoch[38] Batch [40] Speed: 4134.69 samples/sec accuracy=0.877734 cross-entropy=0.358423
INFO:root:Epoch[38] Batch [60] Speed: 4141.81 samples/sec accuracy=0.869531 cross-entropy=0.370238
INFO:root:Epoch[38] Batch [80] Speed: 4044.27 samples/sec accuracy=0.893359 cross-entropy=0.323079
INFO:root:Epoch[38] Batch [100] Speed: 3978.07 samples/sec accuracy=0.873828 cross-entropy=0.353028
INFO:root:Epoch[38] Batch [120] Speed: 4152.50 samples/sec accuracy=0.871094 cross-entropy=0.374185
INFO:root:Epoch[38] Batch [140] Speed: 4238.35 samples/sec accuracy=0.873437 cross-entropy=0.371026
INFO:root:Epoch[38] Batch [160] Speed: 4182.51 samples/sec accuracy=0.892188 cross-entropy=0.329253
INFO:root:Epoch[38] Batch [180] Speed: 4079.07 samples/sec accuracy=0.877344 cross-entropy=0.351393
INFO:root:Epoch[38] Batch [200] Speed: 4004.81 samples/sec accuracy=0.867188 cross-entropy=0.372839
INFO:root:Epoch[38] Batch [220] Speed: 4090.57 samples/sec accuracy=0.878125 cross-entropy=0.357842
INFO:root:Epoch[38] Batch [240] Speed: 4199.65 samples/sec accuracy=0.863672 cross-entropy=0.383540
INFO:root:Epoch[38] Batch [260] Speed: 4027.51 samples/sec accuracy=0.879297 cross-entropy=0.340360
INFO:root:Epoch[38] Batch [280] Speed: 3954.04 samples/sec accuracy=0.869922 cross-entropy=0.368916
INFO:root:Epoch[38] Batch [300] Speed: 3979.02 samples/sec accuracy=0.883203 cross-entropy=0.346545
INFO:root:Epoch[38] Batch [320] Speed: 4035.87 samples/sec accuracy=0.887500 cross-entropy=0.331331
INFO:root:Epoch[38] Batch [340] Speed: 4142.84 samples/sec accuracy=0.892188 cross-entropy=0.329753
INFO:root:Epoch[38] Batch [360] Speed: 4173.68 samples/sec accuracy=0.879687 cross-entropy=0.347904
INFO:root:Epoch[38] Batch [380] Speed: 4174.21 samples/sec accuracy=0.866016 cross-entropy=0.364788
INFO:root:Epoch[38] Train-accuracy=0.874219
INFO:root:Epoch[38] Train-cross-entropy=0.331342
INFO:root:Epoch[38] Time cost=12.191
INFO:root:Epoch[38] Validation-accuracy=0.864383
INFO:root:Epoch[38] Validation-cross-entropy=0.402559
INFO:root:Epoch[39] Batch [20] Speed: 4132.52 samples/sec accuracy=0.867560 cross-entropy=0.376327
INFO:root:Epoch[39] Batch [40] Speed: 4144.84 samples/sec accuracy=0.870703 cross-entropy=0.361661
INFO:root:Epoch[39] Batch [60] Speed: 4191.99 samples/sec accuracy=0.883984 cross-entropy=0.349881
INFO:root:Epoch[39] Batch [80] Speed: 4063.89 samples/sec accuracy=0.877734 cross-entropy=0.370273
INFO:root:Epoch[39] Batch [100] Speed: 4091.36 samples/sec accuracy=0.882422 cross-entropy=0.354485
INFO:root:Epoch[39] Batch [120] Speed: 4105.67 samples/sec accuracy=0.877734 cross-entropy=0.357087
INFO:root:Epoch[39] Batch [140] Speed: 3869.08 samples/sec accuracy=0.874219 cross-entropy=0.351429
INFO:root:Epoch[39] Batch [160] Speed: 4000.32 samples/sec accuracy=0.869141 cross-entropy=0.381346
INFO:root:Epoch[39] Batch [180] Speed: 4068.50 samples/sec accuracy=0.878906 cross-entropy=0.347851
INFO:root:Epoch[39] Batch [200] Speed: 3972.06 samples/sec accuracy=0.874219 cross-entropy=0.371423
INFO:root:Epoch[39] Batch [220] Speed: 3960.63 samples/sec accuracy=0.880469 cross-entropy=0.352270
INFO:root:Epoch[39] Batch [240] Speed: 4063.69 samples/sec accuracy=0.856641 cross-entropy=0.401394
INFO:root:Epoch[39] Batch [260] Speed: 4002.58 samples/sec accuracy=0.880469 cross-entropy=0.331428
INFO:root:Epoch[39] Batch [280] Speed: 4080.73 samples/sec accuracy=0.871484 cross-entropy=0.359382
INFO:root:Epoch[39] Batch [300] Speed: 3987.13 samples/sec accuracy=0.865234 cross-entropy=0.387929
INFO:root:Epoch[39] Batch [320] Speed: 4198.05 samples/sec accuracy=0.882031 cross-entropy=0.339469
INFO:root:Epoch[39] Batch [340] Speed: 4138.34 samples/sec accuracy=0.883594 cross-entropy=0.349967
INFO:root:Epoch[39] Batch [360] Speed: 4140.12 samples/sec accuracy=0.893750 cross-entropy=0.314723
INFO:root:Epoch[39] Batch [380] Speed: 4194.86 samples/sec accuracy=0.872656 cross-entropy=0.377639
INFO:root:Epoch[39] Train-accuracy=0.872396
INFO:root:Epoch[39] Train-cross-entropy=0.361348
INFO:root:Epoch[39] Time cost=12.237
INFO:root:Epoch[39] Validation-accuracy=0.867188
INFO:root:Epoch[39] Validation-cross-entropy=0.409890
INFO:root:Epoch[40] Batch [20] Speed: 4147.38 samples/sec accuracy=0.876116 cross-entropy=0.346307
INFO:root:Epoch[40] Batch [40] Speed: 4013.09 samples/sec accuracy=0.880469 cross-entropy=0.347109
INFO:root:Epoch[40] Batch [60] Speed: 4132.38 samples/sec accuracy=0.874219 cross-entropy=0.361301
INFO:root:Epoch[40] Batch [80] Speed: 4182.50 samples/sec accuracy=0.878906 cross-entropy=0.341350
INFO:root:Epoch[40] Batch [100] Speed: 4085.55 samples/sec accuracy=0.885547 cross-entropy=0.347558
INFO:root:Epoch[40] Batch [120] Speed: 4057.96 samples/sec accuracy=0.878906 cross-entropy=0.349423
INFO:root:Epoch[40] Batch [140] Speed: 4098.60 samples/sec accuracy=0.874219 cross-entropy=0.356224
INFO:root:Epoch[40] Batch [160] Speed: 4182.19 samples/sec accuracy=0.859766 cross-entropy=0.386354
INFO:root:Epoch[40] Batch [180] Speed: 4148.31 samples/sec accuracy=0.876172 cross-entropy=0.363403
INFO:root:Epoch[40] Batch [200] Speed: 4077.16 samples/sec accuracy=0.859375 cross-entropy=0.383028
INFO:root:Epoch[40] Batch [220] Speed: 4256.83 samples/sec accuracy=0.881250 cross-entropy=0.345220
INFO:root:Epoch[40] Batch [240] Speed: 4154.07 samples/sec accuracy=0.875781 cross-entropy=0.360988
INFO:root:Epoch[40] Batch [260] Speed: 4117.51 samples/sec accuracy=0.883984 cross-entropy=0.338444
INFO:root:Epoch[40] Batch [280] Speed: 4152.65 samples/sec accuracy=0.873437 cross-entropy=0.351894
INFO:root:Epoch[40] Batch [300] Speed: 4035.81 samples/sec accuracy=0.880078 cross-entropy=0.352023
INFO:root:Epoch[40] Batch [320] Speed: 3972.75 samples/sec accuracy=0.883594 cross-entropy=0.344791
INFO:root:Epoch[40] Batch [340] Speed: 3966.96 samples/sec accuracy=0.884375 cross-entropy=0.333594
INFO:root:Epoch[40] Batch [360] Speed: 4118.07 samples/sec accuracy=0.888672 cross-entropy=0.313731
INFO:root:Epoch[40] Batch [380] Speed: 4050.04 samples/sec accuracy=0.882422 cross-entropy=0.328160
INFO:root:Epoch[40] Train-accuracy=0.894531
INFO:root:Epoch[40] Train-cross-entropy=0.325990
INFO:root:Epoch[40] Time cost=12.261
INFO:root:Epoch[40] Validation-accuracy=0.852453
INFO:root:Epoch[40] Validation-cross-entropy=0.466116
INFO:root:Epoch[41] Batch [20] Speed: 4153.07 samples/sec accuracy=0.872768 cross-entropy=0.350972
INFO:root:Epoch[41] Batch [40] Speed: 4132.20 samples/sec accuracy=0.880859 cross-entropy=0.352253
INFO:root:Epoch[41] Batch [60] Speed: 4131.84 samples/sec accuracy=0.878516 cross-entropy=0.350259
INFO:root:Epoch[41] Batch [80] Speed: 4145.03 samples/sec accuracy=0.887891 cross-entropy=0.337332
INFO:root:Epoch[41] Batch [100] Speed: 4109.85 samples/sec accuracy=0.878125 cross-entropy=0.361335
INFO:root:Epoch[41] Batch [120] Speed: 4106.47 samples/sec accuracy=0.878125 cross-entropy=0.344732
INFO:root:Epoch[41] Batch [140] Speed: 4115.03 samples/sec accuracy=0.874219 cross-entropy=0.363477
INFO:root:Epoch[41] Batch [160] Speed: 4190.47 samples/sec accuracy=0.872266 cross-entropy=0.359513
INFO:root:Epoch[41] Batch [180] Speed: 4009.44 samples/sec accuracy=0.872266 cross-entropy=0.355679
INFO:root:Epoch[41] Batch [200] Speed: 4094.04 samples/sec accuracy=0.865234 cross-entropy=0.373238
INFO:root:Epoch[41] Batch [220] Speed: 4106.14 samples/sec accuracy=0.866797 cross-entropy=0.361720