Tips-for-improving-your-neural-network-pytorch

A PyTorch implementation for bag of useful tricks

• Stochastic Depth arXiv
• Warm up arXiv
• Label Smoothing arXiv
• No Bias Weight Decay arXiv
• Teacher-Student Knowledge Distillation arXiv
• Mixup arXiv
• Group Normalization arXiv
• Weight Standardization arXiv

---

Installation

pip install -e .

---

Training Example - Cifar10

• modify config.yaml first

python train.py