README.md

🎯 Neural Network - Zero to Hero

A series of learning Neural Network from Zero to Hero under tutorial from Andrej Karpathy. I wrote in .qmd files instead of .ipynb (but there are .ipynb files for viewing in browser!).

Youtube tutorial link: https://www.youtube.com/watch?v=VMj-3S1tku0&list=PLAqhIrjkxbuWI23v9cThsA9GvCAUhRvKZ

🚀 Checklist

1. The spelled-out intro to neural networks and backpropagation: building micrograd
2. The spelled-out intro to language modeling: building makemore
3. Building makemore Part 2: MLP
4. Building makemore Part 3: Activations & Gradients, BatchNorm
5. Building makemore Part 4: Becoming a Backprop Ninja
6. Building makemore Part 5: Building a WaveNet
7. Let's build GPT: from scratch, in code, spelled out.
8. State of GPT | BRK216HFS
9. Let's build the GPT Tokenizer
10. Let's reproduce GPT-2 (124M)

🚧 Rendering

1. pdf: quarto render folder\index.qmd --pdf (not working well!)
2. ipynb: quarto render folder\index.qmd --to jupyter