A practice library for simply implementing a simple neural network.
シンプルなニューラルネットワークをシンプルに実装するための自分練習用ライブラリ。
"NeuralNet32" is under MIT license.
- backpropagation
- optimizer algolithm
- AdaBelief
- AdaBound
- AdaDelta
- AdaGrad
- Adam
- AdaMax
- AMSBound
- AMSGrad
- Momentum
- NAdam
- NAG
- RMSprop
- RMSpropGraves
- SGD
- SMORMS3
- activation function
- ReLU
- tanhExp
- Softmax
- weights initialization
- He
- Xavier
- standard normal distribution
- all same value
- loss
- entoropy error
- dropout
- batch learning