NeuralNet32

A practice library for simply implementing a simple neural network.

シンプルなニューラルネットワークをシンプルに実装するための自分練習用ライブラリ。

License

"NeuralNet32" is under MIT license.

Network function

backpropagation
optimizer algolithm
- AdaBelief
- AdaBound
- AdaDelta
- AdaGrad
- Adam
- AdaMax
- AMSBound
- AMSGrad
- Momentum
- NAdam
- NAG
- RMSprop
- RMSpropGraves
- SGD
- SMORMS3
activation function
- ReLU
- tanhExp
- Softmax
weights initialization
- He
- Xavier
- standard normal distribution
- all same value
loss
- entoropy error
dropout
batch learning