Optimization Algorithms

This repository contains implementations of various optimization algorithms that you might have encountered while using Keras or (Pytorch)[https://pytorch.org/docs/stable/optim.html].

It is an attempt of writing the algorithms in a way that is easy to understand and use from scratch.

Here is the progress of the project:

Name		Name	Last commit message	Last commit date
Latest commit History 37 Commits
.vscode		.vscode
gif		gif
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
adadelta.ipynb		adadelta.ipynb
adagrad.ipynb		adagrad.ipynb
adam.ipynb		adam.ipynb
adamax.ipynb		adamax.ipynb
bgd.ipynb		bgd.ipynb
mbgd.ipynb		mbgd.ipynb
nadam.ipynb		nadam.ipynb
rmsprop.ipynb		rmsprop.ipynb
sgd-momentum.ipynb		sgd-momentum.ipynb
sgd-nesterov.ipynb		sgd-nesterov.ipynb
sgd-weight-decay.ipynb		sgd-weight-decay.ipynb
sgd.ipynb		sgd.ipynb

Provide feedback