Skip to content

nabla27/NeuralNet32

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

36 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

NeuralNet32

A practice library for simply implementing a simple neural network.

シンプルなニューラルネットワークをシンプルに実装するための自分練習用ライブラリ。

License

"NeuralNet32" is under MIT license.






Network function

  • backpropagation
  • optimizer algolithm
    • AdaBelief
    • AdaBound
    • AdaDelta
    • AdaGrad
    • Adam
    • AdaMax
    • AMSBound
    • AMSGrad
    • Momentum
    • NAdam
    • NAG
    • RMSprop
    • RMSpropGraves
    • SGD
    • SMORMS3
  • activation function
    • ReLU
    • tanhExp
    • Softmax
  • weights initialization
    • He
    • Xavier
    • standard normal distribution
    • all same value
  • loss
    • entoropy error
  • dropout
  • batch learning